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ABSTRACT 

The A.R.T.A. Project has completed three years as a 
Title III, 1965 Elementary Secondary Education Act funded project. 
The overall goal was to establish "in house" performance contracting 
to make teaching more effective via an incentive payment system to 
teachers for ahove average gains of students, considering 
achievement, daily attendance, attribution, and self-concept. Thirty 
eight teachers in Kinco, El Reno, and Yukon participated in the 
project in 1971-72, 31 in 1972-73 and 30 in 1973-74. A target 
population consisting of grades two and five, eighth grade math and 
tenth grade language involved 1600 scholastics in 1971-72, 1200 in 
1972-73 and 994 in 1973-74. The defined parts of "target population" 
were realistically evaluated in terms of measurements with a high 
degree of success as well as positive reinforcement of the staff for 
continuation and erpansion. Considering the present status of the 
project, all tests have been administered and students* gains and 
teacher payments have been established for each teacher* s class. 
In-service training sessions have been held to assist the teachers in 
preparing for parental conferences and the ideographic learning 
characteristics of students. Conferences with teachers have been held 
to explain the purposes of the program. (Author/JH) 
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Chapter I 

INTRODUCTION 
Background 




The following is a quote Ly an eminent educator, 
Siegfried Engleman, c^oncerning the need for om imme- 
diate change in educational practice— teacher accounta- 
bility: 

"All children who fail in school have one thing in 
common. They are all products of prior teaching 
that has failed. The reasons for failure are irrele- 
vant. Perhaps the teaching was below average in 
intensity; perhaps it was above average in interv 
sity. In either case it has failed. The educator 
must bring the child up to the level of standard 
performance for children of his age. He must do 
so quickly and efficiently. He must take the 
problem that is given him and solve it. Although 
the role of the remedial educator is quite similar 
to that of the remedial engineer, the educator has 
somehow failed to use the kind of hardnosed, 
product-oriented reasoning that characterizes the 
engineer.^ 

Performance contracting by teachers within the 
system may offer hope for instilling this kind of 
reasoning in the classroom to bring the child up 
to the level of standard performance, considering 
end-produr^'' of achieviement, daily attendance, re- 
duced attrition, and improved self-concept. 



Although the NEA and AFT organizations have 
summarily opposed performance contracting, Donald 
Rumsfeld, former Director of the Office of Econo- 
mic Opportunity, defends performance contracting ex- 
periments as follows: 

. . .by conducting the experiments, the Agency will 
be in a position to provide the educational comm- 
unity with concrete data on which to base decisions 
. . .One would expect, therefore, that news of the 
experiments would be greeted with enthusiasm 
among educators who for years have been voicing 
their concern about education and the poor. . . 
I find it strange that individuals who claim to be 
dedicated to advancing the frontiers of learning 
oppose legitimate efforts to improve methods of 
transmitting knowledge to childrtn."^ 

In a research report by the Oklahoma State De- 
partment of Education, titled Educational Problem 
Ar eas in Oklahoma Schools, Oklahoma school admini- 
strators were reported to view ''effective evaluation 
techniques'' as the primary Innovative practice needed 
in this state, and "performance contracting" was ranked 
tenth. Surely these Oklahoma school administrators are 
striving to find new and innovative methods for improv- 
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ing education thioughout the state, and thny are desirous 
to have reported to them how evaluation techniques and 
performance contracting can be a needful part of this*^ 

The El Reno Teacher Senate Committee, popularly 
elected by teachers, have stated formerly their desire 
for a general increase in salaries, but resources within 
the community for a general increase have greatly dimin* 
ished. The administration decided that salary incentives 
for teachers whose students achieve above normal levels 
would be more receptive to the community, and addi- 
tional funds might be raised for such an innovation. A 
pilot study concerning this problem would indicate to 
administrators in other cities what could be done to 
raise salaries of deserving teachars. This may cause tea- 
chers to be more professional in their relationship with 
students and parents, and unprofessirnal teachers would 
00 longer be protected by a general salary increase. 

There are several known studies in progress which pay 
teachers and/or students for specified gainr in certain be- 
havior. The following are unique examples. 



has been summarized by Russell V/. Paterson, Governor 

of the State of Delaware, as follows: 

When a child fails to learn, school personnel have all 
too often labeled him "slow," "unmotivated," or 
"retarded." Our schools must assu: ie the commit- 
ment that every child shall learn. Such a commit- 
ment must include the willingness to charge a sys- 
tem that does not work, or to find one that does; 
to seek causes^f failure in the system and its' per- 
sonnel, instead of focusing entirely on students.^ 

In January, 1971, Mr. Raymond Roblyer, Director of 
the Canadian Valley Regional Educational Laboratory, and 
Dr. Charles Sandmann, Director of the Educational Plan- 
ning Section of the State Department of Education, mot 
to discuss methods to improve education via incentive 
pay to teachers. This began the planning on the pre* 
sent subject. A preliminary position paper on the sub- 
ject was written in February by IVIr. Roblyer and Dr. 
Sandmann to be presented at the March 9, 1971, meet- 
ing of the State Planning Meeting, which generally app- 
roved the study and mcluded the following attendees: 



In Stockton, California, 327 elenontary and ^00 junior 
high school students participated 'n a study in which 
their teachers were paid for achievement gains of stu- 
dents from 0.8 to 1.6 grade levels per class. Students 
were given prizes for the successful completion of spe- 
cific tasks, attendance, and non-disruptive behavior. 
Teachers could obtain a bonus of either 6% or 12% of 
their salary, depending upon whether they taught math 
and/or reading. 

The Virginia Project was a Title I contract with Learn- 
ing Research Associates of New York City, which had 
guaranteed to improve reading skills by an average of 1.7 
grade levels for $85 per student. The contract was for 
educational services in the form of technical assistance 
and software; teachers employed locally by the school 
boards were being used. Student incentives were award- 
d at the teacher's discretion and were limited to such 
Items as books and released time to make tape record- 
ings. No teacher incentives were reproted. 

These two projects had rewards or incentives to tea* 
chers and/or pupils for specified gains. The Stockton, 
California project was the nearest one, considering ob* 
jectives and physical distance, to the one being proposed 
in the present paper. The purpose of all such studies 



^Siegfried Engleman, Preventing Failure in the Primary Grades. 
Simon and Schuster, (New York. 1969). 

2|n a speech before the San Francisco Chamber of Commerce in 
September, 1970. 

"^Jame^t L. Casey, "Educational Problem Areas in Oklahoma 
Schools," Oklahoma Sijte Department of Education, Research 
Section (January, 1971). 



A dministrator 
Bob Allen 
Jack Beeson 
James Casey 
Bruce Carter 
Gene Rochelle 
Charles Sandmann 
Lederle Scott 
Mrs. Evan L Davis 
Melvin L. Mackey 



Organization 

State Department of Education 

Yukon Public Schools 

State Department of Education 

Governor's Office 

Oklahoma Education Association 

State Department of Education 

Oklahoma Education Association 

State P. T. A. President 

Mmco Public Schools 



Following this meeting, a Local Planning Meeting was 
held concerning the project on March 18, and the follow- 
ing administrators approved of the innovative nature of 
the study and concluded to give it further consideration: 



/^sdministrator 
M. A. Barrcrt 
Jack Beeson 
J. Gilliland 



Organi;;ation 
Union City 
Yukon 

Canadian Valley VO-Tech School 



William H. Henderson Piedmont 



Leonard Harper 
Charles Holleyman 
Molvin L. Mackey 
Leslie Roblyer 
Raymond Roblyer 
Lawrence Sasser 



Bethany 

Mustang 

Minco 

El Reno 

CAVAREL 

Calumet 



This group has served as the primary consultative com- 
mittee for the development of the project and Its im- 
plementation. 

^Russeil W. Paterson, Governor of the State of Delaware and 
Chairnfian, Education Commission of the States; from a speech 
' at the r:OS Conference, (Denver, July, 1970)» 
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St* John's School, Yukon, a member of CAVAREU 
a prior Title Ml project, had been involved in this pro- 
ject frdm it's inception and was a member of the Lo- 
cal Advisory Committee. This committee was needed 
to provide valuable advisory assistance concerning 
needs groups, to coordinate with their publics and 
determine needs; and to represent all regional, cultural 
and ethnic groups* 

GOALS AND OBJECTIVES 

The overall goal of this project was to establish 
"in house'' performance contracting to make teaching 
more effective via an incentive payment system to 
teachers for above average gains of students, consider- 
ing achievement, daily attendance, attrition, and self- 
concept Teachers had not been held responsible or 
accountable for achieving truly effective instruction. 
According to the authors quoted previously, it may 
take a new impetus and environment for change. This 
could be accomplished by offering a positive rev^ard 
to teachers in terms of incentive pay for specified 
student gains, i.e., performance contracting. Teachers 
are impediments to changes in learners when being un- 
professional in handling learning problems; account- 
ability leads to greater professionalism and is a posi- 
tive incentive to needed changes. 

COGNITIVE DEVELOPMENT 

Teachers are the deciding influence in getting stu- 
dents to learn by setting goals that meet idiosyncratic 
needs of students, establishing a positive learning en- 
vironment, focusing upon individual learning problems, 
and establishing follow-up procedures to determine 
v/hether the class is progressing at least at an average 
rate. The cognitive skills of students can be improved 
when these factors are professionally handled by tea- 
chers, and a measure of achievement gains will deter- 
mine the success of teachers in getting their classes 
to make above average gains.^ 

These gains should be measured with respect to the 
abilities of students by determining the I.Q. and 
achievement levels at the beginning of the school year; 
therefore, gains of students were compared with their 
own abilities and not to students in other classes. 
The teacher, therefore, received incentive pay accord- 
ing to how well students achieved above expected 
levels on a standardized achievement test (to be dis* 
cussed in more detail in the evaluation section). 



ATTENDANCE GAINS 

A teacher received incentive pay for ADA levels 
which exceeded those of her students during the pre- 
vious year. ADA was decreased for all unexcused 
absences from class, and the primary concern was 
whether teachers would effectively increase the pre- 
sent ADA of her students when offered a monetary 
incentive. 

ATTfllTiON 

It was determined that the teacher would be con- 
cerned also with lowering the attrition or dropout 
rate from her class. Her incer.tive pay for the first 
year only was decreased for each student he or she 
lost, excluding those whose parents have moved from 
the community. This variable was dropped due to 
excessive community gains of students invalidating 
any comparisons. 

AFFECTIVE DEVELOPMENT 

Starting with the second year of the project, im- 
provement in self-esteem of students as related to 
peers, self, and school was measured. See Cooper- 
smith Self-Inventory and Schnee Secondary School 
Self-Hsteem Inventory for instruments used and their 
objectives. Chapter II. 

FOCUS ON IDIOGRAPHIC CHARACTERISITCS 
OF LEARNERS 

According to Rogers, concentrating on individuals 
instead of the group leads to more empathic under- 
standing, acceptance, and realness In the teaching pro- 
cess. Acting accordingly, the teacher is focusing on 
the values, selftsteem, and attitudet. of the learner 
to find new approaches to adapting the instruction 
to meet his needs. Helping the individual a^so helps 
the rest of the group to learn; Hedegard states that 
the attitudes and drives of students can be focused 
to support group learning* The teacher should ali^o 
become more aware of the social processes in XhA 
classroom which can support learning (Biddle and 
Adams). More personal interaction with the classroo n 
aids the teacher in adapting the instructional press to 
the learner's drive pattern (Siegel and Sicgel). Thus, by 
becoming more involved with individual vnd group 
needs than ever before, the teacher can make positive 
changes in the student's cognitive and affective do- 
mains.® 



^Herbert J. W^^lbert and Gary J. Anderson, "Classroom Climatp 
and Individual Learning," Journal of Educational PsYChology, 
Vol. 69, No* 6, p. 414419, (1968). 



^Lawrence, Siegel, ed. In struction. Some Contemporafv ViawDoints 



OVERVIEW OF GOALS, OBJECTIVFIS, AC /IVITIES, 
and EVALUATION 

Goal: 

1.0 To make teaching more effective by "in house" 
performance contracting with salary incen- 
tives for student cognitive and affective deve- 
lopment. 

Objective: 

1.1 During all the 1973-74 academic year, 1300 
students in grades 2, 5, 8th grade math, and 
10th grade language will be provided class- 
room instruction to improve cognitive 
achievement thvi exceeds gains for one year's 
growth. 

Activities: 

VI. 1 In August, 1973, a select group of teachers 
will be selected/chosen to provide classroom 
instruction. 

1.1.2 During August, 1973, approximately 30 tea- 
chers will attend one pre-service session for 
orientation and identification with thd project. 

1.1.3 During the week of September 16-20, 1973, 
all students will be administered a pretest 
standardized achievement test and all tests 
will be administered by classroom teachers. 

1.1.4 In September, 1973, all participating teachers 
will sot goals for classes and individual stu- 
dents. 

1.1.5 By November 15, 1973, teachers will evaluate 
achievement test results to program or re- 
structure individual curriculums appropriately. 

1.1.6 From September, (973 through May 1974, 
toachers will make home visitations and hold 
conferences with students' parents. 

1.1.7 In April, 1974, during the week of April 21- 
25, all students will be administered a post- 
test, Stanford Achievement Test, Form W. 

1.1.8 During the Academic year 1973*74, all par- 
ticipating teachers will provide classroom in- 
structions appropriate to the local school dis- 
trict's gonis and prescribed regulations set forth 
by local districts and State Department of 
Education. 

1.1.10 A consul tant/eva I uator will be contracted by 
AuguA, 1973, to provide detail program eval- 
uation procedures and submit an outside eval* 
uation by July 30, 1974. 



Evaluation: 

1.1.1.1 Note commensurate dates, location, and ac- 
tivity. 

1 1.2.1 Note pre-service, outlines of program. 

1.1.3.1 Note pretest dates and administered by whom. 

1.1.4.1 Note teacher-classroom goals and individual ac- 
tivity. 

1.1.5.1 Date, test evaluation, diagnosis, restructure 
curriculum. 

1.1.6.1 Note parent conferences, open house, visita- 
tions. 

1.1.7.1 Note posttest, dates, , and forms. 

1.1.8.1 Note pre-service and in-service dates. 

1.1.9.1 Note prescribed goals and continuity, locals 
state regulations. 

1.1.10.0 Compare gains with initial capabililies. Evalua- 
tion results (continuing contract). 

Objective: 

1.2 To increase average daily attendance over the 
previous year's average daily attendance for 
target population of 1300 students in grades 
2, 5, 8th grade math, and 10th grade language. 

Activities: 

1.2.1 In the academic year 1973-74, teachers will 
identify all students by recording names and 
submit a roster, same as permanent register, 
to Project ARTA Central Office by Septem- 
ber 21, 1973. 

1.2.2 During the academic year 1973*74, teachers 
will make additional home visitations and hold 
parent conferences. 

1.2.3 During the academic year 197374, teachers 
will communicate with parents/students dur- 
ing illness or excessive absenteeism of students. 

1.2.4 Teachers will have previous year's attendance 
(1973) by January 1, 1974, to compare on- 
going attendance with present year's atten- 
dance and submit present school attendance 
record by May 28, 1974. 

1.2.5 During the academic year 197374, teachers 
will submit a list of all new students (to pro- 
ject ARTA Central Office by April 16, 1974) 

9 
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to include previous school attended and loca- 
tion. 

1.2.6 Teachers are to encourage better attendance 
than previous year's attendance and may use 
a reward system. 

1.2.7 Teachers are required to keep an active anec- 
dotal record on e^ch stuc*' nt and is to be 
submitted to Project ARIA Central Office by 
May 28, 1974. 

Evaluation: 

1.2.1.1 Nota required register and due date. 

1.2.2.1 Note required home visita^.ons and conferen- 
ces. 

1.2.3.1 Note methods of communication. 

1.2.4.1 Note attendance comparision and due date. 

1.2.5.1 Note new students and geophysical location. 

1.2.6.1 Note variaNe reward systems. 

1.2.7.1 Note anecdotal record and date due. 

1.2.8.1 TTest of significant differences will be used. 

Oblective: 

1.3 To improve self-concept for target population 
of 1300 students in grades 2, 5, 8th grade 
math, and 10th grade language. 

Activities: 

1.3.1 To administer Self-Esteem pre^^st during the 
week of September 16-21, 19 . 

1.3.2 To provide individual attention academically 
to instill confidence. 

1.3.3 To hold parent conferences throughout school 
year to relate success at school. 

1.3.4 To help develop successful attitude-j-self- 
concept as related to home, peers, self, and 
school. 

1.3.5 To keep ? ^ecdotal record through school year. 

1.3.6 To administer posttesl in April, 1974. 
Evaluation: 

1.3.1.1 Note self*dsteem pretest inventory dates. 
1.3.2.1 Counsel student^peer, home-school attitudes. 



1.3 3.1 Note anecdotal record requirements. 
1.3.4.1 To evaluate posttest gains over pretest. 
1.3.5.1 Observations. 

Objective: 

1.4 To reduce attrition and prevent dropouts for 
target population of 1300 students in grades 
2, 5, 8th grade math, and 10th grade lan- 
guage. 

Activities: 

1.4.1 To record all students' entries and withdrawals. 

1.4.2 To record and identify all students to Project 
ART A rontral Office by September 16, 1974. 

1.4.3 To hold counseling sessions with school Psy- 
chologist and Psychometrist regarding stu- 
dents. 

1.4.4 To have parent conferences. 

1.4.5 To provide Project ARTA with a classroom 
record for all students for the year and sub- 
mit data to Project ARTA by May 28, 1974. 

1.4.6 To keep anecdotal record fur academic year. 
Evaluation: 

1.4.1.1 Note required identifiable date to Project 
ARTA. 

1.4.2.1 Noie dates of entries and cut-off. 
1.4.3.1 Note conferences with other departments. 

1.4.4.1 Note anecdotal record. 
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Chapter II 

DESCRIPTION OF 
PROJECT A.R.TA. 
ACTIVITIES 

Target Population 

The A.R.T.A. Project, "A Road to Accounta- 
bility/' has completed three years as a Title lll« 
E.S.E.A., funded project. Thirty-eight teachers in 
Minco, El Ren^, and Yukon participated in the pro- 
ject in 1971-72, 31 in 1972-73, and 30 in 1973-74. 
Second and third years of operation were decreased 
in number of teachers because of decrease in appro- 
priation. Twenty-five teachers were retained during 
1972-73 wfth six new teachers being added. 

A target population consisting of grades 2 and 
5, 8th grade math, and 10th grade language, involved 
1600 scholastics in 1971-72, 1200 in 1972-73 and 
994 in 1973-74. The target groups were selected 
to represent all levels of elementary ^nd secondary 
education. The curriculum areas selected also repre- 
sented basic skills, which led to more valid generali* 
zations of the effectiveness of the program. The de- 
fined parts of "target population" were realistically 
evaluated in terms of measurements with a high de- 
gree of success as well as positive reinforcement of 
the staff for continuation and expansion In the 
overall structure the attempt was made to design a 
system that does take in the community goals and 
board of education goals as well as district objectives, 
school objectives, individual teacher objectives, and 
student objectives. 



Considering the present status of the project, all 
tests have been administered and students' gains and 
teacher payments have been established for each tea- 
cher's class. In-service training sessions have been held 
to assist the teachers in preparing for parental confer- 
ences and the idiographic learning characieristics of 
students. Conferences with teachers have been held 
to explain the purposes of the propram, and classroom 
visits by Mr. Roblyer havr helped t(v increase under- 
standings by all. Questionnaires have been used 
with teachers in an attempt to determine biblio- 
graphic characteristics, methocs of teaching, changes 
in the learning situation, etc. 

1973-1974 FORMULAS FOR INCENTIVE PAYMENTS 

The formulas for incentive payments were as 
follows: 

Elementary: $=[2400 (a)+13.3(b)+100(c)l x d 
Secondary: $=(2400 (a)+32.0(b)+100(c)l x d 

Variable (a) is the net achievement term from 
the table of incentive payments (presented later). 
It is calculated by subtracting the expected gain 
from the attained achievement gain. Tnis term is 
then multiplied by $2400, the dollar^wcighted 
constant for achievement gains. 

Variable (b) is the net self esteem term from 
the table obtained by subtracting the expected gain 
of 10.00 for elementary or 3.50 for secondary from 
the attained self-esteem growth. This net self-esteem 
is then multiplied by the dollar constant of 13.3 for 
elementary or 32 for secondary. These constants are 
different due to having different test instruments. 

Variable (c) is the nut average daily attendance 
(ADA), which is obtained by subtracting the mean 
ADA for 1972-73 from the mean ADA for 1973-74. 
$100 is the constant for ADA 

The final term in the equation, (d), gives the 
fractional part of $2000 for which the class is worth. 
For example, one section of mathematics (or any 
other curriculum) could earn $400 for the teacher 
if maximum gains occur. Since $400 is 1/5 of $2000« 
the term (d) for any one section is 1/5 or 0.2. 

The equation is computed for each section that 
a teacher entered into the project, and then the dol- 
lar gair^s, if any, of each section are added for the 
teacher's total payment. Five class sections are vaiued 
at $2000 because 5 x 0.2 ($2,000) = $2,000. Also, 
any self-contained classtoom, e.g., second grade, could 
have attained the maximum payment if the reading 
and at thmetic gains (worth 0.5 of $2,000 each), 
along /vith attrition and attendance, were high enough. 

11 



These three constants were changed from year- 
to-year for two reasons: (a) to equalize numerically 
between the typical gains made achievement, self- 
esteem, and average daily attendance: (b) to make 
each of the trhee aforementioned factors have dollar 
weights of 60%, 20%, and 20%, respectively. 
Dollar Weights must be pre-determined for each Mtc- 
tor in order to set the minimum net gain allowe*. 
for maximum incentive payments. Each factor is set 
so that approximately 25% of the teachers with high- 
est net gains will receive maximum payment on any 
or all factors. 

The row total in dollars may exceed the maxi- 
mum allowed row payment If a teacher had a net 
gain greater than the minimum net gain for maximum 
payment. Maximum row payments depend upon the 
payment factor (d) for the section or class. For ex- 
ample, the maximum row payment is $1,000 in a self- 
contained class for reading achievement with a pay- 
ment factor of 0.5. A math teacher with five sec- 
tions of math could receive $2,000 maximum for the 
five sections; each section would have a payment fac- 
tor of 0.2 and be worth $400 as a row maximum. 



PARENTAL CONFERENCES 

Teacher conferences with parents were deter- 
mii*jd as necessary for learning the histories of indi- 
vidual students, which leads to individualizing activi- 
ties for cognitive and affective gains. Needs and atti- 
tudes of students can be determined from home back- 
grounds, and the teacher and parents can combine ef- 
forts to motivate the child. There were several at- 
tempts on the teacher's part to improve the learning 
environment in the home. The parents came to un- 
derstand that the school is doing much more than pre- 
viously to meet students' needs. Ideal p!aces for the 
conferences in order of preference were a central 
meeting place, school, and student's home. 

The results of these conferences were maintained 
on the Anecdotal Record form (See chart). This 
form was also used to record other information about 
the student to aid in diagnosing learning problems. 

DESIGN AND METHODOLOGY 

The first year's operation was submitted to an 
on*going evaluation during the year as well as the for- 
mat being presented to the evaluation assessment of 
the adequacy of three stated objectives of the project: 

Objective 1: To provide classroom instruction 
to improve congitive achievement that ex- 
ceeds gains for one year's growth. 



The normal gain for all classrooms is established 
nationally as 1.0; therefore, the same criteria was used 
in the present evaluation, The Stanford Achievement 
Test was used on a pretest and posttest basis to deter- 
mine individual gains in all four grade levels. 

It was decided that the teachers would adminis- 
ter the tests, which were made available to the class- 
room teachers one day before the tests were to be 
administered. Make-up tests for those students absent 
were permitted as soon as the student returned to 
class. Central A.R.T.A. office personnel did all of . 
the scoring on the instruments, thereby eliminating ; 
teacher responsibility. Preventive measures were taken 
to keep the test scoring out of the realm of any fak« 
prejudices or accusations from outside sources. 

Test score results were returned to the chssroom teacher 
for general use to assist her in identifying the weaknesses 
and strengths of her students. By early diagnosis, the 
teacher could then structure her daily curriculum material 
to benefit the child through iridividualized instruction as 
well as ^roup instruction. 

The Stanford Achievement Test was used on a pretest- 
posttest basis to determine Individual achievement gains 
in all fout grades. 

Grade Level 
2 Primary I 

5 Intermediate I 

d (Math) Advanced Arithmetic Test 

10 (English) High School English and 
Spelling Tests 

The proidct did not provide significant amounts of 
material (soft or hardware) for the classroom teacher, 
nor was there any instructional guidelines presented to the 
classroom teacher. Each teacher taught her classes in ac* 
cordance with the school district policies and procedures 
that have been in effect for the past year, and she was 
free to cover the grade content material of instructions 
appropriate for their sections or levels of instructions. 

Objective 2: To increase Average Daily Attendance 
over the previous year's Average Daily 
Attendance. 

In order to increase daily attendance, the teachars 
were requested to make additional home visitations and to 
hold conferences. It was evidenced through anecdotal 
records which each teacher kept on her students that 
additional conferences were held, and some outstanding 
records reflected greater concern for students' welfare and 
educational growth. 

A retrieval method was used to obtain last year's at- 
tendance records for new students to the district, as well 
as those who were not new to each system. Permanent 
registers were used as the official source to obtain this 
data. Sixteen percent of all students participating were 
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migrants from othar school districts outside of the three 
participating scho >)$. Only those students who were given 
the pretests were i &ed in comparing their previous at- 
tendance with this year's attendance. 

Objective 3: To reduce attritic.i and prevent drop- 
outs. 

Each teacher was charged with any attrition which oc- 
curred with her student population, which included losses, 
gains, transfers, drops, and expulsions. Permissive trans- 
fers for excessive problems conce'ning teacher/student 
relations was not of a significant factor; however, a few 
were identified. 

The attrition factor or variable, being chargeable to the 
teacher, proved to be beyond the teachers' ability for an 
effective control. However, the variable has merit, and it 
is recommended for continuation in the project but not 
be chargeable for monetary incentive payment. 

Objective 4: To improve self-esteem, 



This variable was not included for 1971-72 but was im- 
plemented for the school year 1972-1973. Teachers have 
reacted verry positively to the self-esteem pretest item 
analysis of their students and have gained considerable 
insights of individual students. 

Chapter IV contains in-service training materials used 
in three to four evening workships during each school 
year to assist teachers in meeting the objective for improved 
self-esteem of their students. The workshops provided 
theoretical and practical solutions for establishing a class- 
room environment that facilitates a student's perception 
of himself as related to school success, peer relations, and 
general self-concept. 

Changes in students self-esteem were determined by the 
Coopersmith Self-Esteem Inventory (grades 2 and 5), and 
Schnee Secondary School Self-Esteem Inventory (grades 
8 - 10) which measures the self-concept of the person in 
relation to school, peers, and general self. The instruments 
and the objectives around which they were developed 
are on the (.ages which follow. 



PROJECT A.,^.T.A. 
Anecdotal Record 



Name. 
1. 



2. 



6. 



7. 



9. 



10. 



Parent Visitation: 

Home visits 

Phone visits 

P.T.A. visits 

Social ^visits 

Open 



House. 
Others- 



visits 
-visits 



(Give number of times or frequency) 
Peer Relationship: 

Good Bad Indifferent 

Teacher/Student Relationship: 

Good Bad Fair 



4. Referred Behavior: 



Principal. 



^Psychiatrist. 



Parent 
Letter 



5. Parent Reaction to Conferences: 



Bad. 



Good 

Parent Feedback: 
Immediate Action 
Environmental Status: (Home) 

Good Average 

Students Health: 
Good 



.Indifferent 



No Reaction 



-Fair 



Fair 



Average 



Physical Appearance: Include Clothing 

Good Average Fair 

First Impression of Student: 

Good Others 



11. Professional Recommendations: 



Grade 

Previously Retained: 

(If Yes, what grade? 

ATTENDANCE: 
Regular 



Yes 



Year 
.No_ 
) 



.Irregular 



Achievement: Performs best by: 



, Psychologist 



Counselor 



Dean 



-Defends Action Taken 



. Cooperative 



Rec; ptiv'O 

Poor 



Malnutrition 



.Poor 



Defends Students Actions 



Chronic llliness 



Last of Year Impression of Student: 
Good Others 
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COOPERSMITH SELF-eSSTEEM INVENTORY 
(Confidential) 

Score , 

Name ^ School 

Teacher Grade Date 

Sex Age Race 

INSTRUCTIONS: If the statement describes how you usually feel, put a check ( ) in the columr "LIKE ME/' If the statement does not 
describe how you usually feel, put a check I ) ' . the column "UNLIKE ME". There are no r'* vf anwvars. Words or phrases in parentheses 
add nteaning to (he statement. 

LIKE ME UNLIKE ME 

1 . I spend a lot of time daydreaming. 

2. I'm pretty sure of myself. 

3. I would rather be myself than anyone else. • 

4. Tm easy to like. 

5. I enjoy talking in front of the class. • 

6. I wish I were younger. 

7. There prft many things about myself that I would change if I could. ' • 

8. I can make up my mind without too much trouble. 

9. I'm a lot of fun to be with. 

10. I'm happy with (proud of) my school work. 

1 1 . Someone usually has to tell me what to do . 

-12. I can adjust to (get used to) new things easily. 

13. I seldom do things that I am sorry for later. 

14. I have many friends my own age. 

15. I do the best work that I can in class. 

16. I don't give in easily when I think I'm right. 

17. I can take care of myself. 

18. I'm usually happy. 

19. I would rather play with children younger than I am. 

20. I don't like to be called on in class. 

21 . I have reasons for the things that I do. • 

22. Things are all mixed up in my life. 

23. I can make up my mind and stick to it. 

24. Kids liko my ideas. 

25. I'm not doing as well in school as I'd like. 

26. I really like being a boy (or girl). 

27. I'm not ashamed of what I am. 

28. I like the way that I look. 

29. I like being with other people. 

30. I seldom feel upset (uneasy) in school. 

31. If I have something to say, I say It. 

32. I don't care what happens to me. 

33. I think I'm doing O.K. 

34. Kids pick on me. 

35. My teacher likes me. 

36. I really get upset when I'm fussed at (scolded). 

37. Things usually don't bother (upsot me) for very long. 

38. I can be trusted. 

39. Other people are liked better than I am. 

40. My school work makes me feel discouraged (hopeless). 
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ITEM ANALYSIS FOR ELEMENTARY SELF-ESTEEM 
INVENTORY 

L TERMINAL OBJECTIVE - The student demon- 
strates behaviors which indicate regard of himself 
as a person of worth and value. 

A. Objective: Chooses own courses of action 
(adequacy) 

11. Someone usually ha? fo XM me what to do. 

13. I seldom do things that I am sorry for later. 

23. I can make up my mind and 'tick to it. 

32. I don't care what happens to me. 

B. Objective: Selects and defends a position 

2. I'm pretty sure of myself. 

8. I can make up my mind without too much 
trouble. 

16. I don't give in easily when I think I'm right. 

21. I have reasons for the things that I do. 
31. If I have something to say, I say it. 

C. Objective: Accepts nis perception of himself in 
general. 

1. I spend a lot of time daydreaming. 

3. I would rather be myself than anyone eisa. 

6. I wish I were younger. 

7. There are many things about myself that 
I would change if I could. 

12. I can adjust to (get used to) new things easily. 

17. I can take circ of myself. 

18. I'm usually happy. 

22. Things are all mixed up in my life. 

24. Kids like my ideas. 

26. I really like being a boy (or girl.) 

27. I'm not ashamed of what I am. 

28. I like the way that I look. 

33. I think I'm doing O.K. 

37. Things usually don't bother (upset) me for 
very long. 

38. I can be trusted. 

D. Objective: Acc :pts failure and success 

36. I really get upset when I'm fussed at (scolded). 

II. TERMINAL OBJECTIVE - The student assumes a 
positive role in interpersonal relationships. 

A. Objective: Understand and accept one another 
(peers) 

4. I'm easy to like. 

9. I'm a lot of fun to be with. 

14. I have many friends my own age. 

19. I would rather play with children younger 
than I am. 

29. I like being with other people. 

34. Kids pick on me. 

35. My teacher likes me. 

39. Other people are liked better than I am. 

B. Objective: Assumes various roles in goal-oriented 
groups. 

III. TERMINAL OBJECTIVE - The student demon.- 
strates behaviors which indicate positive adjustment 
to the school environment. 

A. Objective: Confidence in front of others 

5. I enjoy talking in front of the class. 

20. I don't like to be allied on in class. 
30. 1 seldom feel upset (uneasy) in school. 



B. Objective: Pride in school work 

. 10. I'm happy with (proud of) my school work. 

C. Objective: Achieves at highest level possible. 
15. I do the best work that I can in class. 

25. I'm not doing as well in school as I'd like. 
40. My school work makes me feel discouraged 
(hopeless). 

ITEM ANALYSIS FOR SECONDARY SELf-ESTEEM 
INVENTORY 

I. TERMINAL OBJECTIVE - The student demonstrates 
behaviors which indicate regard o^ himself as a person 
of worth and value. 

A. Objective: Chooses own courses of action (ade- 
quacy) 

1. I can usually make up my mind about some* 
thing without asking anyone first. 

10. Someone usually has to tell me what to do. 
19. 1 seldom do things that I am sorry for later. 
27. I don't care what happens to me. 

33. I can make up my mind and stick to it. 

39. There are many things that I would like to do, 
hut I usually go along with what others want. 

B. Objective: Selects and defends a position. 

2. I don't give in easily when I think Tm right. 

11. I have reasons for the things that I do. 
20. If I have something to say, I say it. 
28. 1 like to debate my ideas. 

34. 1 think I can help to change things. 

C. Objective; Accepts his perception of himself in 
general 

3. I would rather be myself than anyone else. 
12. 1 can take care of myself. 

21* There are many things about myself that I 
would change if I could. 

29. I can be trusted. 

40. I think I'm doing O.K. 

43. I'm not ashamed of what I am. 
□..Objective: Accepts failure and success. 

4. I really get upset when I fail at anything. 
13. 1 don't make a big deal out of being nght. 
22. I learn fro.o my mistakes. 

30. When I'm wrong, I like for people to tell me. 

36. When nice things happen to me, it is only 
good luck and nothing I did to deserve it. 

41. When bad things happen to me, it is usually 
someone else's fault. 

II. TERMINAL OBJECTIVE - The student assumes a 
positive role in interpersonal relationships. 

A. Objective: Understand and accept one another 
(peers) 

8. Km easy to like. 

17. People like my ideas. 

25. People often embarrass or hurt me. 

31. Other people are liked better than I am. 

37. My interests are shared by other students. 

42. I have many friends my own age. 
44. 1 like being with other people. 
45. 1 try to be friends with another person even 




if he isn't friendly to me. 



B. Objective: Assumes various roles in goal-oriented 
groups. 

9. I like to be the leader in all activities. 

18. Getting along with others is more important 

to me than always being first* 
26. I like to share leadership responsibilities with 

others. 

32. I would rather work with only my close 
friends in school activities. 

38. I can seldom make other people do things I 
want them to do. 

TERMINAL OBJECTIVE - The student demon- 
strates behaviors which indicate positive adjustment 
to the school environment. 

A. Objective: Confidence in front of others 

5. I enjoy talking in front of the class. 

14. I don't like to be called on in class. 

B. Objective: Pride in school work 

6. I recheck my school work to make sure that 
it is neat and correct. 

15. I'm proud of my school work. 

23. I'd be pleased to have examples of my class- 
work displayed during open house, 

C. Objective: Achieves at highest level.possible. 

7. I do the best work that I can in class. 

16. I'm not doing as well in school as I'd like. 

24. My school work makes me feel discouraged, 



DETERMINATION OF INCENTIVE PAYMENTS 

The first step in determining injentive payments was to 
list the teachers involved, their subject areas and grade 
level, and the number of sections that each teacher had 
entered into the evalution for payments. Table I, gives 
the ARTA and control group teachers, along with the 
other information needed. 

Table II gives the distribution of Project teachers by 
years of experience and age, Although these data did not 
enter into actual incentive payment calculations, thay did 
describe the range of ages and experiences involved, 

The memorandum on page 32 gives the 1973-1974 
pretest results for each teacher, along with the statistically 
determined expected gains established for each section. 
After the pretest level was determined, the expected igain 
in achievement was set such that a class of average students 
would be expected to gain only at the national average. 
This average gain in grade equivalent scores would be a 
gain of 1.0 year. A class of lower ability students would 
not be expected to gain as much. 
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SCHNEE SECONDARY SCHOOL SELF-ESTEEM INVENTORY (1972) 

(Confidential) 

SE Score . 



Name ^ School 

Teacher — Gra6e Date 

Sex Age "Race 



DIRECTIONS: If tne statement describes how you usually feel, put a chock ( ) In the column "LIKE IVIE." If the statement does not 
describe how you usually feel, put a check ( ) in the column "UNLIKE IVIE." 

If IBM onswer cards are used, fill in the bubble in the first column for "LIKE ME/' and fill in the bubble in the second 
column for "UN LIKE ME." Make no marks in the two right-hand columns. 

^ 

REMEMBER: There arc no right or wrong answers. The answer which comes to mind first is probably the best one. 

LIKE ME UNLIKE ME / 

1 . I can usually mar e up my mind about something without asking anyone first. 

2. I C »n't give up easfily when I think I'm right. 

3. Iw .»d rathw be m/self than anyone else. 

4. I really get upset when I fall at anything. 

5. I enjoy talking In front of the clr«. 

6. I racheck my school work to nr.ake sure that it is correct. 

7. I do the best work that I can In class. 

8. I'm easy to like. 

9. I like to be the Iftater In all activities. 

l'^. Someone usually has to tell me what to do. 

11. I have reasons for the things that I do. 

1 2. I can take care of myself. 

1 3. I don't make a big deal out of being right. 



27. I don't care what happens to me. 

28. I like to debate my Ideas. 

29. I can be trusted. 

30. When I'm wrong, I like for people to tell t^ne. 

31. Other people are liked better than t am. 

32. I would rather work with only my close friends in school activites. 

33. I can make up my mind end stick to it. 

34. I think I can help to change things. 

35. I wish I were younger (or older). 

36. When nice things happen to me, it is only good luck and nothing I did to deserve it. 

37. My interests are shared by other students. 

38. I can seldom make other people do things I want them to do. 

39. There are many things that I would like to do, but I usually go along with what 
others want. 

40. I think I'm doing O.K. 

41. When bad things happen to me, it is usually someone else's fault. 

42. I have many friends my own age. 

43. I'm not ashamed of what I am. 

44. I like being with other people. 

45. I try to be friends with another person even if he isn't friendly to me. 
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Name 

ELRENOTEACHERS 
Donnie Asbury 
Donna Pbsey 
Vickie Patterson 
Sharon Adams 
Joan Baker 
Merrilee Srookshire 
Dorothy Almond 
Gladys Cordray 
Judy Tackett 

mInco teachers 

Janle Moroz 
Betty Jones 
Martha VIckrey 
Marilyn Hahn 
Yvone Hatchor 
Bruce Treadaway 
Evelyn Albers 
YUKON TEACHERS 
Gladys King 
Peggy Piersall 
Elbert Vaughan 
Mary Lou Ford 
Diane Gray 
Patricia McDanlel 
Verna Umfleet 
Janice Weller 
B. James ^/)cCcy 

2nd Grade: Students 

El Reno 74 

Minco 29 

Yukon 43 — 

Total 146 

CONTROLLED GROUP 
2nd Grade 
Diane Stout - 6 
Paula Ellison -20 
(Yukon) 



TABLE I 

1973-1974 TEACHER ENROLLMENT 
IN PROJECT ARTA, TITLE III, E.S.E. 



School 




Grade 




niMcrest 




o 




Uncoln 




o 




nose Witcner 




9 

ii 




nlllcrest 




R 
O 




MMlcrest 




R 




Webster 




5 




Rose Witcher 




5 




Lincoln 




B 
o 




Jr. High 




o 
O 




Minco 








Minco 








Minco 




0 




Minco 




D 




Minco 




Q 

o 




Minco 




10 




Minco 




10 




Myers 








Central 




2. 




oneuecK 




R 








5 




Shedeck 




5 




Shedeck 


• 


5 




Shedeck 




5 




Shedeck 




5 




Jr. High 




8 




5th Grade: 


Students 




8th Grade: 


El Reno 


150 




El Reno 


Minco 


35 




Minco 


Yukon 


1Q9 




Yukon 


Total 


377 




Total 



School Yeai 1973-1974 



*Semi-Departmentalized 

Subject Area Total Students 

Contained 26 

Contained 24 

Contained 24 

•Math-Read (3) (66) 

•Lang.Sci.(3) 166) 

Contained 33 

Contained 28 

Contained 23 

Math (5) 143 

Contained 14 

Contained 15 

Contained 18 

Contained 17 

Math (2) 50 

English (1) 14 

English (1) 29 

Contained 21 

Contained 22 

•Math (8) (192) 

••Lang. Arts (2) 50 

•Soc.Stud. (8) (192) 

••Lang. Arts (2) 47 

••Lang. Arts (2) 47 

••Lang. Args(2) 48 

Math (5) 139 

Students 10th Giade: Students 

143 El Reno 0 

50 Minco 43 

i^Q Yukon —0 — 

332 Total 43 



5th Grade 8th Grade 10th Grade 

Jamey Hedgecock - 28 Carolyn Williams - 19 Charles Cosgrove - 23 

(El Reno) (Yukon) (Yukon) 

Total - 898 

Total Controlled Group - Grand Total - 994 
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TABLE II 

DESCRIPTION OF TEACHER POPULATION 
"A.R.T.A. PROJECT" 

Grade Number of Teachers Project Area 

2 7 Contained Classroom 

5 5 Contained Classroom 

5 8 5emi-Department8!ized 

and Departmentalized 

8 3 Math 

10 — 1 — English 

24 Total Teachers 
E! Reno 9 Teachers 
El Reno — 9 Teachers 

Minco 6 Teachers 

Yukon — 9 Teachers 
19 - BS Degree 5 - MS Degree 



Years of Experience 

2 

3 ■ 

4 

£, 

7 

8 ■ 

9 

14 

15 

17 

26 

34 

AGES OF TEACHERS 61 

47 
45 
43 
41 
40 
38 
37 
35 
34 
33 
30 
28 
27 
26 
26 
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MEMORANDUM October 1973 

To: Rpyrrwnd Roblyer. ARTA Project Director 
From: Ron Schnee, Evaluation Consultant 
Subject: 1973-74 Pretest Results 

TABLES l-l V give the achievement and self-esteem pretest means and expected gains for each teacher. Expected gains in achievement 
vary according to the grade level or standard score mean, but expected gains in self-esteem are fixed for elementary and secondary teachers, 
as follows: ' 



Grades 

2,5 

8J0 



Expected %-tile Gain in Setf-Esteem 
10.00 
3.50 



SECOND GRADE PRETEST RESULTS 



District 


Teacher 


Subject 


%-tile Mean 


Grade Score Mean 


Expected Gain 


El Reno 


Asbury 


Reading 


66 


2.2 


1 nft 






Math 

Self -Esteem 


60 
41 


2.1 


1.03 


El Reno 


Poioy 


Reading 
Math 

Self-Esteem 


43 
39 
40 


2.0 
1.9 


1.00 
.97 


El Reno 


Patterson 


Reading 
Math 

Self-Esteem 


31 
44 
63 


1.8 
2.0 


.94 

1.00 


Minco 


Jones 


Reading 
Math 

Self-bsteem 


62 
60 
36 


2.3 
2.1 


1.09 
1.03 


Mincn 


Moroz 


Reading 
Math 

Self-Esteem 


66 
70 
46 


2.2 
2.4 


1.06 
1.12 


Yukon 


King 


Reading 
Math 

Self-Esteem 


68 

64 
59 


2.4 
2.3 


1.12 
1.09 


T UKUn 


riersaii 


Reading 
Math 

Self-Esteem 


47 
44 
42 


2.1 
2.0 


1.03 
1.00 


Yukon 


Ellison 
(Control) 

Stout 
(Control) 


Reading 
Math 

Self-Esteem 

Not enough in Class 


19 
39 
43 


1.7 
1.9 


.91 
.97 






FIFTH GRADE PRETEST RESULTS 






District 


Teacher 


Subject 


%-tile Mean 


Grade Score Mean 


Expected Gain 


El Reno 


Adams 


1 -Reading 
1-M2th 

1 - Self-Esteem 

2- Reading 
2Mdth 

2- Self-Este6m 

3- Reading 
3*Math 
3-S6lf- Esteem 


46 
26 
54 
37 
24 
41 
37 
34 
36 


4.9 
4.3 

4.6 
4.2 

4.6 
4.5 


.97 
.79 

.88 
.78 

.88 
.85 


El Reno 


aaker 


1- Language 
1 -Science 
1 -Self-Esteem 


36 
44 
54 


4.4 
4.9 


.82 
.97 
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District 


Teacher 


Subject 


' %*tile Mean 


Grade Score Mean 


Expected Ga 






2* Language 


36 


4.4 


.82 






2*Sclence 


40 


4.7 


01 






2*Self*E&teem 


4i 










3*Language 


35 


4.3 


.79 






3-Sclence 


44 


4.9 


.97 






3-Self*Esteem 


36 






El Reno 


Stanley 


1 'Social Science 


34 


4.5 


.85 




(Control) 


2-Social Science 


40 


4.7 


.91 






3-Social Science 


38 


4.6 


Bo 


El Reno 


Srookshire 


Reading 


35 


4.5 


J5 






Math 


18 


3.9 


.67 






Self-Esteem 


41 






El Reno 


Al mond 


Reading 


28 


4.2 


.76 






Math 


21 


4.1 


.73 






Self-Esteem 


50 






El Reno 


Cord ray 


Reading 


34 


4.4 


.82 






Math 


34 


4.5 . 


£5 






Self-Esteem 


57 






El Reno 


Hedgecock 


Reading 


31 


4.3 


.79 




(Control) 


Math 


21 


4.1 


.73 






Self-Esteem 


36 






Minco 


Hahn 


Reading 


35 


4.5 


.85 
.76 






Math 


24 


4.2 






Sfilf-Esteem 


51 






Minco 


VIckrey 


Reading 


51 


5.1 


4 AO 

1.03 






Math 


31 


4.4 


•82 






Self-Esteem 


67 






Yukon 


Ford 


^Reading 


68 


5.8 


1.24 






1 -Language 


48 


A f\ 

4.9 


.87 






1-Self-Esteem 


60 










2-Reading 


51 


5.1 








2*Language 


42 


A C 

4.6 


•DO 






2-Self-Esteem 


27 






Yukon 


McOaniel 


1 -Reading 


51 


5.1 


1.03 






Language 


50 


5.0 


1.00 






1-Self-Esteem 


28 










2*Reading 


41 


4.8 


t%A 

.94 






2-Language 


36 


4.4 


.82 






2*Self-Esteem 


32 






Yukon 


Umfleet 


1*Reading 


52 


5.2 


1.06 






1*Language 


44 


4,7 


.91 






1*Self*Esteem 


46 










2*Reading 


41 


4.8 


Ail 

.94 






2- Language 


41 


4.5 


OB 

.88 






2*Self*Esteem 


27 






Yukon 


Weller 


1*Reading 


52 


5.2 


1.06 






1 'Language 


50 


5.0 


1.00 






rSelf'Esteem 


32 










2- Reading 


39 


4.7 


.91 






2*Language 


35 


4.3 


.79 






2*Setf*Esteem 


37 
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EIGHT GRADE PRETEST RESULTS 



District 



Teacher 



El Reno 



Tackett 



Minco 



Yukon 



Hatcher 



McCoy 



Yukon 



Williams 
(Control) 



Subject 


%-tile Mean 


Grade Score Mean 


Expected ( 


MVIath 


30 


6.9 


.67 


1 *wwl 1 *C9lUlllll 












7 Q 


.97 


2*Self*Esteem 


49 




3-Math 


42 


7.8 


.94 


3-Self'Esteem 


S3 






4-Math 


40 


7 7 


01 


4*Self-Estflem 


60 






5-Math 


47 


R n 


1 nn 
1 .uu 


S'Self-Esteem 


59 






1*Math 


30 


6 9 


R7 
.0/ 


1 'Self-Esteem 


39 






2-Math 


?7 


64 


.Da 


2*Self-Esteem 

^ 1 1 mm V % V Will 


39 






1-Math 


34 


7.2 




1 -Self -Esteem 


61 






2-Math 


27 


6.7 


.61 


2*Self -Esteem 

& 1 i mm w ^ V Will 


41 






3-Math 


3& 


7 3 


70 


3-Self- Esteem 


29 






4-Math 


30 


6.9 


.67 


4-Self-Esteem 


27 






S^Math 


44 


7.9 


.97 


5-Self-Esteem 


52 






6-Math 


29 


6.8 


.64 


6-Self-Esteem 


52 






1-Math 


29 


6.8 


.64 


1*Self*Esteem 


20 







TENTH GRADE PRETEST RESULTS 

^■>'strict Teacher Subject %-tile Mean Standard Score Mean Expected Gain 

irVlinco Albers 1 -English 24 43 2.8 

1-Self-Esteem 53 

Minco Treadaway 1 -English 43 48 3.0 

1 -Self-Esteem 48 

Yukon Cosgrove 1-English 25 43 2.8 

1-Self-Esteem 23 
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Chapter III 

INCENTIVE PAYMENTS 
AND EVALUATION 
RESULTS 

FORMULAS FOR INCENTIVE PAYMENTS 

he formulas for Incentive payments for 1973- 
1974 were as follows: 

(1) Elementary: [2400 (a) ^ 13.3 (b) + mo (c) 1 x d 

(2) Secondary: [2400 (a) + 32.0 (b) + 100 (c)l x d 
Variable (a) Is the net achievement term calculated by 
subtracting the expected gain from the attained achieve- 
ment gain. Variable (b) Is the net sel l^-esteem term obtained 
by subtracting the expected gain of 10.0 for elementary or 
3.5 for lecondery from the attained sulf-esteem growth of 

a teacher's students. Variable (c) Is the net average dally 
attendance, which Is the difference between current A.D.A. 
of students and that of the previous year. The final term 
of the equation, (d), gives the fractional part of $2000 
(a teacher's maximum Incentive payment for 1973-74) 
for which the class was worth. 

One pert of the formula was changed since 1972-73. 
The expected self-esteem growth of elementary students 
was relied from 3.6 to 10 percentiles because high gelns 
(and higher standard errors) during the last two years had 



made the lower figure Invalid. The present formulas were 
held constant In respect to assigning the achievement, 
self-esteem, and A.D.A. factors weights of 60%, 20% and 
20%, .espectlvely. 

ACHIEVEMENT 

As Indicated In Table III, the overall mean achievement 
growth during 1973-74 was 1.61 grade scores, as compared 
to 1.60 for 1972-73 and 0.96 for 1971-72. Very little 
Improvement was seen In the program over the previous 
year since most of the Improvement had occurred between 
the first two years of the project. The second grade gains 
continued to decline, whereas, the fifth graders continued 
to Improve. All grade levels made positive gains during 
1973-74 and 1972-73. 

The net achievement gains (attained minus expected) 
are shown In Table III, row II. The overall net achieve- 
ment gain Increased to 0.63 from the previous year. This 
means that the achievement scores exceeded the nationally 
normed growth of 1.0 grade equivalent score by 0.63, 
which Is six months growth above the expected norm. 

It would appear that the achievement gains during 
1973-74 were no better than during 1972-73; In some 
respects, they were slightly worse. But Project ARTA still 
continued to meet Its achievement objective. I.e., to make 
achievement gains which were above the national norm. 

Table IV gives the mean achievement growth scores In 
self-esteem and the academic areas for each grade level and 
District. This Is not a part of the formal evaluation but 
may be of use to administrators. 

SELF-ESTEEM 

Table III also presents the net self-esteem gains during 
1973-74 and 1972-73. The overall net gains per teacher 
averaged 12.8 percentiles, as opposed ^if^ 13.2 for the 
previous year (no significant difference).. The fifth and 
tenth graders improved In net gains, while second and 
eighth graders declined from the previous years. 

Net selfesteem scores Indicate that ARTA students 
continued to score higher 

In self-esteem than expected. Expected levels were set In 
relation to a nor Tiing group sampled In 1970-71. There- 
fore, the self-esteem objective for Project ARTA was 
attained. 



AVERAGE DAILY ATTENDANCE 

According to Table V, the overall A.D.A. of ARTA 
students declined slightly from the previous year but 
exceeded the A.D.A. of the first year of the project. 
The overall net A.D.A. of Table I, row III, of 1.07 Indi- 
cates that during 197374 the students in the project 
Improved their dally attendance by about one student 
r class over their previous year's attendance. 
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District 



Grade 



TABLE IV 

1973-1974 MEAN ACHIEVEMENT GROWTH BY DISTRICT AND GRADE 
Subject Area Pre Mean P ost Mean 



Achievement 
Growth 



El Reno 


2 


Heading 


2.00 


3.08 


1:08 






Math 


?.00 


3.59 


1.59 






Self-Esteem 


48 


86 


38.0 


Minco 


c, 


neaaing 


9 9R 










Math 


2.25 


2.70 


0.45 






Self*Esteem 


40 


45.5 


5.5 


T UKOn 


9 


noauing 


9 9R 










Math 


2.15 


3.59 


1.44 






Self-Esteem 


51 


77 


26.0 


El Reno 


5 


Reading 


4.60 


6.10 


1.50 






Math 


4.26 


5.60 


1.34 










fill 








Science 


4.83 


7.68 


2.85 






Self-Esteem 


48.0 


67.7 


19.7 


Minco 


5 


Reading 


4.80 


6.67 


1.87 






Math 


4.30 


5.93 


1.63 






wol 1 CalBBlii 




75 E 


Ifi B 


Yukon 


5 


Reading 


5.09 


6.92 


1.83 






1 2inmi9fia 




fi B4 


1 86 






Math 


4.78 


6.18 


1.40 






Social Science 


5.51 


6.91 


1.40 






Self-Esteem 


34.88 


65.75 


30.87 


El Reno 


8 


Math 


7.66 


8.88 


1.22 






Self*Esteem 


52.2 


47.4 


-4.80 


Minco 


8 


Math 


6.65 


8.96 


2.31 






Self-Esteem 


39.0 


41.5 


2.50 


Yukon 


8 


Math 


7.13 


9.53 


2.40 






Self-Esteem 


43.67 


47.50 


3.83 


Minco 


10 


English 


45.5 


45.6 


0.10 






Self-Esteem 


60.5 


61.0 


10.50 



NOTE: Methods of reporting are as follows: 

Achievement in grades 2, 5, 8: grade equivalent scores 
Achievement in grade 10; percentiles 
Self-Esteem scores: percentiles 
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TABLE III 



COMPARISON OF AVERAGE STUDENT GAINS BY 
YEAR AND GRADE LEVEL 

Grade Level Overall Gains 







2 


5 


8 


10 


Per Stud 


L 


Achievement Growth 














(Grade Scores): 










1 .01 




1973-74 


1.07 


1,74 


1*93 


0,10 




1972-73 


1.19 


1.72 


2.24 


l.b/ 


1.60 




1971-72 


1.60 


1*18 


1*65 


-1.12 


.96 


IL 


Net Achievement 














(Grade Scores): 










63 




1973-74 


♦07 


./*♦ 




—9 7*> 
/O 




1972-73 


«22 


on 






B4 




1971-72 


Jo 


•40 


•/o 




—fl 1Q 


IIL 


Net. A.D.A. 














(Students/Class): 










1.07 




1973-74 


1.73 


.75 


1.20 


3.00 




1972-73 


3.89 


.99 


1.75 


-3.10 


1.85 




1971-72 


2.18 


-1.19 


^1.40 


-0.06 


-0.58 


IV. 


Net Self-Esteem 














(%-tiles): 














1973-74 


15.4 


16.5 


- 2.3 


7.0 


12.8 




1972-73 


19.0 


13.3 


0.2 


6.3 


13.2 



TABLE V 

1973-1974 AVERAGE DAILY ATTENDANCE BY 
GRADE AND DISTRICT 



District Grade 1973-1974 1972-1973 1 972-1971 



El Reno 


2 


168.0 


168.6 


165.1 




5 


166.5 


170.0 


168.0 




8 


167.7 


168.3 


167.3 




10 




165.5 


168.8 


Minco 


2 


168.2 


170.9 


165.4 




5 


171.1 


172.1 


167.1 




8 


172.2 


173.4 


171.8 




10 


168.0 


1G9.9 


171.9 


Yukon 


2 


166.7 


167.7 


164.2 




5 


168.1 


168.3 


168.7 




8 


168.0 


170.2 


167.5 


Overall 


2 


167.8 


169.1 


164.9 




5 


167.9 


170.1 


167.9 




8 


168.6 


170.6 


168.9 




10 


168.0 


167.7 


170.4 



The A.D.A. of tenth grade English f cudents Increased 
almost three students per class during 1973-74. This is 
a remarkable Improvement for these tenth graders, and 
it Is hoped that the efforts of the English teachers caused 
the improvement. 

Because the overall net A.D.A. improved (1.07) by 
about one student per class over their previous attendance, 
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the project met its A.D.A. objective for a positive net 
A.D.A. score. All grade levels had positive scores in net 
A.D.A. 

INCENTIVE PAYMENTS 

Table VI gives the average incentive payments for each 
grade level and year of Project ARTA. Since the maximum 
dollars, i.e., the budget for instruction, was decreased each 
year by the Title III Advisory Committee, the best com- 
parison of yearly effectiveness in terms of money is row 
III, the percent of maximum dollars paid to teachers. As 
compared to 1972*73, which seems to be the year in which 
gains peal<ed, the percent of maximum dollars available 
for incentive payments 

decreased from 71% in 1972-1973 to 64% in 1973-1974. 

The final level of incentive payments was average for 
the project if the three total percentages are averaged. 
The only grade level to receive an incentive payment equal 
to the previous year was tho fifth grade. The reader should 
remember that the fifth grade was the only one which 
improved in achievement over 1972-73. 

EXPERIMENTAL-CONTROL GROUP COMPARISONS 

A control group of volunteer teachers was added to 
the evaluation during 1973*74. They were matched to the 
experimental group by grade level, subject taught, Dis- 
trict, initial motivation (all volunteered), and in-service 
training. All testing in controlled groups occurred at the 
same time and under the same instructions as experimental 
classes (Project ARTA teachers). Table VII compares the 
gains of experimental and control groups. 

25 



TABLE VI 

COMPAFi-SON OF YEARLY INCENTIVE PAYMENTS BY GRADE LEVEL 

Grado Level 



8 10 Total 



I. Incentive Payment ($); 

1973-1974 5,197 19,323 3,325 0 $27,957 

1972- 1973 14,693 20,362 3,942 114 39,111 

1971 - 1972 20,900 12,230 3,300 208 36,668 

II. Maximum Possible ($): 

1973- 1974 14,000 24,400 4,800 800 $44,000 

1972- 1973 22,000 25.600 4,800 2,400 54,800 
197M 972 22,000 25,600 6,000 6,800 60,400 

III. Percent of Maximum Dollars 
Paid to Teachers (%); 

1973- 1974 37 79 89 0 64% 
1972-1973 67 79 82 S 71 
197M 972 95 47 56 3 60 



TABLE VII 

EXPERIMENTAL/CONTROL GROUP COMPARISON OF GAINS 

1973-1974 

Grade Level Overall Gain 
2 5 8 10 Per Teacher 



1. 


Achievement Growth 














(Grade Score): 














A. Experimental 


1.07 


1.74 


1.93 


0.15 


1.61 




B. Control 


.72 


1.10 


.33 


-7.10 


.95 




C. A-B 


.35 


.64 


1.60 


7.25 


.66 


II.. 


Net Achievement 














(Grade Scores); 














A. Experimental 


.07 


.74 


.93 


-2.75 


.63 




B. Control 


- .23 


.13 


- .31 


-9.90 


- .02 




C. AtB 


.30 


.61 


1.24 


7.15 


.65 


III. 


Net A.D.A. 














(StudenU/Clast); 














A. Experimental 


1.73 


.75 


1.20 


3.00 


1.07 




B. Control 


-0.20 


1.53 


1.30 


-10.50 


-0.22 




C. A-B 


1.93 


- .78 


- .10 


t13.50 


1.29 


IV. 


Net Self- Esteem 














(%-tiles): 










12.8 




A. Experimental 


15.4 


16.5 


-2.3 


7.0 




B. Control 


-26.0 


-11.0 


-0.5 


4£ 


-11..? 




C. A-B 


41.4 


27.5 


-1.8 


2.5 


24.2 



ACHIEVEMENT 

Row I of Table VII gives the growth means of achieve* 
ment for the two jroups, and the final column gives the 
overall gains per teacher* The A-B rows indicate the dif- 
ference in growth between experimental and control 
groups; a positive number for A-B is a difference in favor 
of the experimental group (Project ARTA students)* 
Project students had a mean achievement growth of 1*61, 
while controls gained only 0*95 grade equivalent scores* 



Therefore, the experimental group gain was 0.66 years 
more than the control group gain during 1973*74* 

In row II, the net achievement of project students was 
0.63 years vs. -0.02 years for controls. This means that 
project students scored 0.63 years above the nationally 
normed gain of one year, and controls scored *02 years 
below the one year gain. Therefore, Project ARTA students 
had achievement gains which exceeded those of the control 
group by 0*65 years. 

26 21 



AVERAGE DAILY ATTENDANCE 

Row Wl Table VII, gives the difference in A.D.A. of the 
two groups, Project students had a net difference over 
controls of 1.29 students per class. These advantages 
occurred mainly through the efforts of second and tenth 
grade teachers. 

SELF-ESTEEM 

The final rovw in Table VII Indicate the tremendous 
differences in self-esteem growth of the two groups. The 
net gain of the experimental group was 12.8 percentiles 
over expected levels, while controls scored 1 1.4 percen- 
tiles below the criterion of two standard errors gain. This 
made the experimental group's self-esteem growth to be 
24.2 percentiles above the control group, which Is equival- 
ent to a year's difference in grade equivalent scores. 

Two-way analyses of variances were performed on the 
four groups of data in Table VII. For each ANOVA, the 
independent variables were the treatment groups and 
grade level in school. The dependent variables were achieve- 
ment growth, net achievement, net A.D. A., and net 
self -esteem. 



All F-ratios between the experimental and control 
groups were significant at the .01 level of confidence. The 
F-ratios of between/within variance ranged in size from 
6.98 to 14.71. An F-ratio of 6.85 or greater wa«: required 
for significance at the .01 level with df=(1 ano 1?0). 
Therefore, all gains of the experimental group were 
significantly greater than those of the control group at the 
.01 level of confidence. 

SUMMARY AND CONCLUSIONS 

1. Project ARTA met its objective in achievement: achieve- 
ment .scores exceeded the nationally normed growth 
of 1.0 grade equivalent score by 0.63 years, which is 
six months growth above the national norms. 



2. The self-esteem objective was met; the cvorall net gain 
per teacher was 12.8 percentiles above the expected 
level of two standard errors. 

3. The average daily attendance objective was also attain- 
ed: during 1973-74, project students improved their 
A.D.A. over the previous year by 1.07 students per 
class. Assuming an average of 30 students per class, 

a 3% gain in A.D.A. school-wide would be a positive 
improvement in time and money, which absenteeism 
costs. 

4. Incentive payments decreased 7% from 1972-73 which 
was the peak year for percent of maximum do! jrs 
paid to teachers with 71%. Therefore, 1973-1974 

was an average year for teachers' receiving maximum 
incentive money, 

5. The experimental group of Project ARTA students had 
significantly greater growth than controls in achieve- 
ment, self-esteem, and A.D.A. 

a. Project students had achievement gains which ex- 
ceeded the controls by 0.65 years. 

b. The self-esteem growth of project students was 
24.2 percentiles greater than controls. 

c. Project students had a net gain In A.D.A. of 1.29 
students per class over controls. 

It was interesting to note that ARTA teachers did so 
well as compared to the control group In 1973-74, even 
though ARTA teachers were having only an ''average" 
year. 

INCENTIVE PAYMENTS PER TEACHER 

The detailed analysis of gains and the Incentive pay- 
ments for each teacher are included in Table VIII. The 
information from Table VII was used to develop the 
previous table in the evaluation report. 
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OKLAHOMA 
Title 1 1 1, ESEA 

PROJECT SELF-EVALUATION REPORT 

(For use by Project Director and staff) 

Project Tit;^: ARTA-A Road To Accountability 
Date of Evaluation: April 4, 1974, Evaluator: Raymond 
Roblyer/Dr. Ron Schnee 

In the space provided please state each of your ob]ectiv')s. 
Below the stated objective, give a percentage estiiudte of 
achievement for the objective. 

Basis for rating achievement could be: (1) percentage of 
gains made on measuring instruments or by participants; (2) 
percentage of participants who have fully accomplished 
the objective; (3) percentage of total quantity of outcomes 
expected; (4) a percentage of some other specified means 
of measuring the objective. 

For each objective please give evidence to verify the 
achievement of the objective. 

OBJECTIVE 1: 

To provide classroom instruction to improve cognitive 
achievement that extends gains for one year's growth. 

Percentage of achievement 75%. 

BASIS: Final evaluation of cognitive gains will be made 
after April posttesting. Objective 1 will be com- 
pleted at that time. 

Measurement instrument used: Standard Achievement 
Tests 

Describe the statistical date treatment: An average expect- 
ed gain of 1.0 grade equivalent score was estab- 
lished for each class of each teacher. 



yeais of Project ARTA, program gains in 
achievement exceeded expected gains. 

OBJECTIVE 2: 

To increase average daily attendance of students over the 
previous year. 

Percentage of achievement 75% 

BASIS: Final evaluation of ADA gains will be made after 
May attendance rates are obtained; at this time, 
this report is only 75% complete. 

Measurement instrument used: ADA reports obtained for 
LEA'S. 

Describe the statistical data treatment: Nominal comparison 
of 1973-1974 ADA and 1972-73 ADA rates 
for target students. 

EVIDENCE: (1) What was accomplished? (2) Who achiev- 
^jd what? (3) When? (4) How was it achiev- 
ed? (5) Reasons for not achieving objective 
at expected level? 

Teachers made a concerted effort to im- 
prove student's attendance over previous 
years. They contacted students at home if 
necessary and attempted to keep students 
in class unless they were ill. During the 
previous year, ARTA student's ADA in- 
creased from 1971-72 to 1972-73 by al- 
most two days per stu lent. 

OBJECTIVE 3 

To improve self concept for target population fo 1300 
students over criterion gains set for elementary and 
secondary classes. 

Percentage of achievement 75% 



EVIDENCE: (1) What was accomplished? (2) Who 

achieved what? (3) When? (4) How was it 
achieved? (5) Reasons for not achieving 
objective at expected level. 

Teachers have used in-service training ideas 
and materials to improve instruction for 
Individual students. The Stanford Achieve- 
ment Tests were administered on a pre- and 
posttest basis and comparisons of gains 
were made with expected gain set for each 
teacher's class(es). If the teachers in the 
program were more successful than those 
across the nation in adapting instruction 
to individual students, then program gains 
will exceed the average expected gain of 
1.0 grade level. Final determination of the 
program's success on objective 1 will be 
made in May, 1974. During the first two 
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BASIS: Classroom efforts by teachers to improve stuuents' 
self-esteem is % completed at the present time, 
Final evaluation will be made in May. 

Measurement instrument used: Elementary and Secondary 
Self-Esteem Inventories. 

Describe the statistical data treatment: Comparison of 
self-esteem gains with established criteria, 

EVIDENCE: (1) What was accomplishGd? C ) Who achiev- 
ed what? (3) When? (4) How was it achiev'^ 
ed? (B) Reasons for not achieving objectives 
at expected level? 

During 1973-74, teachers used special in- 
service training practices for improving 
students' self^steem. Individual and gro^tp 
33 intervention programs were instituted in 
the classrooms. During the previous year, 



1^ 



(1) 



(2) 



students' gains iri self-esteem exceeded the 
criterion by 13.18 percentiles. This was a 
most significant gain in self*esteem by 
elementary and secondary students in public 
schools* 

Please describe beiow the kind(s) of innovative or 
exemplary practice (s) occuring in this project: 

a. Product (instructional materials, videotapes, 
learning machines, software/hardware, etc.) 
Description: Improvement of self-esteem trans- 
lated into specific classroom objectives with soft* 
ware and hardware support programs. 

b. Practice(s): (Particular practices, pre/in-service 
training, youth-tutoring-youth, methodology, 
etc.) 

Description: In-house performance contracting 
with teachers with student outcomes established 
for accountability. 

c. Procedures: (special processes, systems spproaches, 
decision-making models, organizational develop- 
ment, etc.) 

Description; An organization plan whereby 
teachers are given incentive payments for above 
average gains in achievement, ADA, and self- 
esteem. 

d. Staff Configuration: (staff development and dif- 
ferentiation of functions, staff student ratios, use 
of aides, paraprofessionals, volunteers, private 
school personnel, etc.) 

Description: 

e. Unusual Applications: (utilization of traditional, 
unusual, or new materials and/or equipment in new 
or different ways.) 

Description: 

f. Educational Climate: (facilities, staff student inter- 
action patterns. Interrelationships, uniquely 
trained leadership, etc.) 

Description: 

Are outside consultants involved in the project? In 
which phases of the project? If so, who? When? 
What methods and criteria are being used? Dr. Ron 
Schnee - Oklahoma City Public Schools - Statistics 
& Evaluation, Mr. Gene Steiger ^ Oklahoma City 
Public Schools - In-service, Janet Shelden - 
Oklahoma City Public Schools - In-service, Betty 
\ »vang Oklahoma City Public Schools - In-service, 
Cam Byrd - Oklahoma City Public Schools - In- 
service. 



In-service, Evaluation and Consultative Services 
(If additional space is needed, attach additional copy to 
this page) 



(3) DISSEMINATION 



Recipients or Participants 





Kind 


(dumber 


Statewide Diffusion (Ed/ 
Fairs, T.V., other) Activites 


Brochures Ed« 
ucational Fair 
Area Adm. 
Meetings 


1000 
20 


Civic clubs, P.T.A. 's 
etc., presentations 


Lions Club 
P.T.A. 


55 
85 


Individuals visiting 
your project 


School Personnel 


5 


roxenxiai aaoptors given 
technical assistance 


Broken Arrow, 
Cherokee, Sapulpa 
Sand Springs 
Bartlesville, Texas 
(SEA) 


7 


Schools that have adopt- 
ed components of your 
project 


New Hampshire 




Brochures & other printed 
materials sent out from 
project 


Individual teachers 
of 3 LEA Districts 
Other School 
Districts 


500 
1000 


Inservice training outside 
your school 


none 


0 


Local inservice 


Project Personnel 


31 


Community Involvement Local advisory 
(people on committees, group Adminis- 
advisory groups, co-ops, etc.) trators 


12 
17 



Total 



2832 



(4) 



(5) 
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What action has been taken by the SCHOOL BOARD 
to support the continuation of the project? State 
Mandate Accountability - Minco Testing Complete 
School - Outside agency from Shawnee. 
What are the specific plans for continuation of the 
program next year? 

a. Relative to increased local funding (if project 
is in the ffrst 2 years of Title III funding) 
Third year 

b. Relative to total non-federal funding (if project 
is in final year of Title III funding) 
Administrators decision - component parts to 
continue. 

a. Which components of this project would you 
most readily recommend for adoption by others? 
why? 

1. Holding teachers and school buildings ac« 
countable for producing certain student out- 
comes - reasonable outcomes. 

2i Self-concept improvement as an objective 
which is as important as congnitive improve* 
ment 



b. What age level learner would each of the above 
components best serve? 

1. Beginning with kindergarten and up through 
grade 12 

c. What modification would you recommend for the 
less readily adoptable components to make them 
more adoptable by others? 

1« Decrease Incentive payments to several hundred 
dollars. 

2« Adapt the payment formula to local needs, 
priorities, and objectives - for establishing 
variables. 

3. Give teachers and principals the opportunity 
to determine the student outcomes for which 
they will be held responsible. 

4. Incorporate Into present accountability plans. 

OKLAHOMA 
Title III, ESE A 

PROJECT EVALUATION FORM 
(for use by Evaluation Team) 

I. INTRODUCTORY INFORMATION 
School or Institution: Minco Public Schools 
Location: Minco - El Reno - Yukon 

Title of Project: A Road to Accountability (ARTA) 
Date: April 9, 1974 

Team Member Evaluator(s): Keith Stone, Chairman; 
Bob Plumlee, Joe Bob Weaver, Don Rushing, Sarah 
Webb, Jim Cox, Sherman Garrison. 

II. RATING 

Instructions: Rate the following questions by placing 
a check ( ) in the appropriate box which indicates 
your feeling. A rating of 5 is the highest and a rating 
of 1 Is the lowest. 

Scale: 5 - Superior, 4 - Above Average, 3 - Average, 
2 - Below Average, 1 - Poor, ) — Not Ap- 
propriate. 



lnnovat!veness: 

1, Innovative and/or exemplary 

features of the project (as demon- 
strated by its operation are 



B 4 3 2 1 0 

X 



Comment on innovativeness or exemplary features: 
Although the project is in the last year of funding, 
it still seems to be very innovative, and could serve 
as a model for implementation of accountability. 
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Effectiveness/Success : 

1. Evidence that progress has been 
made toward solving stipulated 
critical needs is 

2. Statement of performance ob- 
jectives in measurable terms 
(who Is to do what, at what 
level of performance, and under 
what conditions?) Is 

3. Cited evidence for the achieve- 
ment of objectives Is 

4. Proportion of objectives which 
can realistically be expected 
to be achieved Is 

5. Instrumentation used to mea- 
sure objectives is 

6. Availability and use of base 
line data are 

7. Analysis of the data is 

8. Evidence that the evaluation 
is being carried out according 
to the approved design Is 

9. Extent to which previous 
evaluation recommendations 
have been implemented is 



5 4 3 2 1 0 



2 X 



3 X 



7 M 



8 X 



10. Evidence that project activ- ^ 
ities have significantly improv- 
ed participant behavior is 

11, As a signifi :ant contribution 11 x 
to the improvement of educa- 
tion this project is 

Comment on effectiveness/success: Identify the 
stronger and weaker objective (as listed in the pro- 
gram self-evaluation report) state why and suggest 
improvements, 

The number of variables that enter into ADA mea« 
suring objectives tend to make it unrealistic to achieve 
at a high level of accuracy. Reduce the variability in 
testing procedure. 



Cost Effectiveness/Economy: 

1 . Proportion of costs being as- 
sumed by district as project 
progresses is 

2, Benefits dr^rived from the 
project in relation to costs 

35 ai*^ 



5 4 3 2 1 0 



2 X 




# 



Ability to implement the pro- 
gram from other funds is 

4* Maintenance of expenditure 
level as defined by 2.9 State 
Guidelines and Reguliitions 
governing Title III, ESEA 
programs (supplementing not 
supplanting) is 

5. Accounting procedure for the 
Title 1 1 1, ESEA grant funds is 

6 Extent to which costs are being 
related to objectives or com- 
ponents of proj^'ct is 

7. Reports to the State Depart- 
ment In accordance with 
requirements have been 

8. Evidence that efforts are 
being made to continue the 
project's positive features 
after the termination of 
Federal funding is 

9. General financial management 
appears 



Exportability and involvement: 

1. Awareness of the project's purpose 5 4 3 5 10 



4 X 



5 X 



6 X 



2. 

3. 
4. 

5. 



9 



7. 



Comment on cost effectiveness/economy: Identify 
budgetary discrepancies, (relationship of adminis- 
trative cost to program cost, not exceeding budget 
functions approved, extreme costs). Note accounting 
deficiences, and comment on funding plans. 



among other persons is 

Efforts aimed toward dis- 
seminating the project's pur- 
poses and results are 

Provision for participation of 
non-public schools is 



1 



Board representation of the 
cultural and/or educational 
resources and their utilization 
are 

Extent to which the project 
is documented and disseminat- 
ed so others might replicate 
it is 

Extent to which non-specialized 
staff, their training, the mater- 
ials, facilities, and equipment 
lend themselves to adoption by 
other districts is 



Compliance with Title VI of the . 
Civil Rights Act and all regulations ^ 
thereto is 



6 X 



Comment on exportability and involvement: Suggest 
particular involvement where lacking and recommend 
improvements for exportability. 



General financial management appears to be adequate, 
*8 Accountability aspect will probably be utilized 
by other districts. Incentive pay will not be continu- 
ed. 



Committee commends the project for the two pub- 
lications (a) Accountability: Performance Contract- 
ing, and the (b) brochure "A Road to Accountability." 
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General: 

5 4 3 2 1 0 

1. General administration of the 

project is 1- ^ 



2, Among the staff, the under- 
standing of the goals and ob- 
jectives is 



3. The performance and ef* 
ficiency of the staff is 



4. Extent to which staff utilizes 
systems analysis processes is 



5. Suitability of facilities and 
equipment to carry out the 
project is 



6. Existance of clear-cut 
separation of this project 
activity from regular district 
activity yet close coordination 
and association is 



7. Program management 
techniques used for needs 
assessment, planning, im- 
plementation and evaluation 
are 



Comment on general: Suggest specific improvements 
for the administrator of the project to implement 
and list other comments you wish to make, 

Write a final position paper for the total project 
inclusive of evaluation results for last year. If pro- 
ject is to be used as a model, consideration needs 
to be given to the full accountability process, Some 
method needs to be devised whereby someone other 
than the classroom teacher administers the pre-test 
and post-test. This would assure a more standarized 
testing situation and, hopefully, tend to make the 
tests more valid. 

It is not feasible to assume the normal gain for all 
classrooms will be the national average of 1.0 grade 
level per year. A more extensive study of the ex- 
pected gain of the various ability level students 
should be an integral part of the study. 



BEST copy mm 
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CHAPTER IV 



IN-SERVICE TRAINING MATERIALS FOR SELF- 
ESTEEM 

IMPROVEMENT AND THE DIAGNOSIS 
OF RELATED PROBLEMS 

A.R.T.A, In-Service 

September 5, 1972 
October 24,1972 
December 5, 1972 
February 13, 1973 
April 17, 1973 

ORIENTATION TO FOUR SESSIONS 

XIassroom Management as a Tool for Increased Achieve* 
ment and Self-Concept Development'' 

SLIDE - TAPE PRESENTATION 

''How Educational Diagnosis Can Be Accomplished" 

LARGE GROUP INTERACTION 

1. How can educational diagnosis help improve achieve- 
ment? 

2. How can educational diagnosis help improve student 
self-concept? 

SMALL GROUP INTERACTION 

Leader Teacher 

Janet Shelden Self Contained Elementary (2niJ & 5th) 
Gene Steiger Departmentalized Reading (5th Gr.) 
Betty Hwang Departmentalized Math (5th & 8th Gr.) 
Cam Byrd English (10th Gr.) 

EDUCATIONAL DIAGNOSIS 

WHY IS DIAGNOSIS NECESSARY? 

1 • To determine appropriate objectives. 

2. To select appropriate learning activities. 

WHAT SHOULD BE DETERMINED IN DIAGNOSIS? 

1. Student abilities and needs. 

a. Skills 

b. Knowledge 

c. Thinking 

d. Attitudes 



2. Discover student learning patterns. 

a. Interests 

b. Learning Style 

c. Rate of Learning 
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HOW CAN DIAGNOSIS BE ACCOMPLISHED? 

1. Testing 

a. Informal 

b. Standardized 

2. Interview 

a. Informal 

b. Structured 

3. Observation 

a. Informal 

b. Structured (e.g., checklist) 
WHEN SHOULD DIAGNOSIS BE DONE? 

1 . Continuously 

2. May be emphasized more at timei (e.g. at the begin- 
ning of a year or when beginning on a particular 
unit of work). 

OBJECTIVES FOR DEVELOPMENT OF SELF-ESTEEM 
AND CLASSROOM ADJUSTMENT 

Terminal Objectives 

Three Terminal Objectives have been identified: 

1 . The student demonstrates behaviors which indicate 
regard of himself as a person of worth and value. 

2. The student assumes a positive rols in interpersonal 
relationships. 

3. The student demonstrates behaviors which indicate 
positive adjustment to the school environment. 

These terminal objectives are too broad to be measured 
directly. Therefore, each has been subdivided Into enabling 
objectives which are described below as student behaviors* 

Each student behavior is accompanied by a teacher be- 
havior which should contribute to the accomplishment of 
the enabling objective. Both terminal and enabling ob- 
jectives are outlined below. 

Terminal Objectives and Accompanying Enabling Ob - 
jectives 

1. TEFi /IINAL OBJECTIVE ^ The student demon- 
strates behaviors which indicate regard of himself 
as a person of worth and value. 

A. ENABLING OBJECTIVE 

1 . Student Behavior: Chooses own course of 
action 
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2. Teacher Behavior: Presents courses and 

critique which will allow 
and encourage the student 
to choose his own courses 
of action 

B. ENABLING OBJECTIVE 

1. Student Behavior: Selects and defends a 

positiori 

2. Teacher Behavior: Provides relevant topics 

for discussion 

C. ENABLING OBJECTIVE 

1. Student Behavior: Accepts his perception of 

himself in general, 
(satisfied with age, sex 
role, etc.) 

2. Teacher Behavior: Provides for interaction 

with acceptable adult 
models of a child's sex 
role 

D. ENABLING OBJECTIVE 

1 . Student Behavior: Expresses self adequately 
to others 

Z Teacher Behavior: Encourages individual ideas 
and differences. 

E. ENABLING OBJECTIVE 

1. Student Behavior: Accepts failure and suc- 

cess 

2. Teacher Behavior: Reinforces successes and, 

critiques failures, and 
initiates successful follow- 
up actions. 

F. ENABLING OBJECTIVE 

1. Student Behavior: Identifies proudly with 

own ethnic group 

2. Teacher Behavior: Provides materials em- 

phasizing the positive con- 
tributions of the student's 
ethnic group to society 

G. ENABLING OBJECTIVE: 

1. Student Behavior: Improves personal pride 

and acceptability to others 
(e.g., grooming, general 
health, etc.) 

2. Teacher Behavioi: Encourages individual 

pride and devises activi- 
ties to emphasize good 
health and grooming 



TERMINAL OBJECTIVE - The student assumes a 
positive role in interpersonal relationships. 

A. ENABLING OBJECTIVE 

1. Student Behavior: Understands and accept^ 

others 

2. Teacher Behavior: Provides opportunity for 



III. 



exchange of ideas and in- 
terests 

B. ENABLING OBJECTIVE 

1. Student Behavior: Plays with children (peer- 

group) of his own dge and 
of other ages 

2. Teacher Behavior: Encourages children to 

talk of home life, hobbies, 
goals, etc. 

C. ENABLING OBJECTIVE 

1. Student Behavior: Assumes roles in goal* 

oriented groups 

2. Teacher Behavior: Provides for groups within 

the classroom with student 
activity leaders 

D. ENABLING OBJECTIVE 

1. Student Behavior: Interacts with many other 

students 

2. Teacher Behavior: Plans activities that will 

permit the greatest num- 
ber of interactions 

E. ENABLING OBJECTIVE 

1. Student Behavior: Assumes roles other than 

leader in group activities 

2. Teacher Behavior: Encourages individual 

participation in various 
roles within group activi- 
ties 

F. ENABLING OBJECTIVE 

1. Student Behavior: Shows appreciation of the 

contribution of all ethnic 
groups in our society 

2. Teachor Beh* /ior: Assigns tasks which expose 

students to the contri- 
butions of all ethnic 
groups 

TERMINAL OBJECTIVE - The student demon- 
strates behaviors which indicate positive adjustment 
to the school environment. 

A. ENABLING OBJECTIVE 

1. Student Behavior: Shorn confidence in 

front of others and with 
others 

2. Teacher Behavior: Provides latitude for 

selection of topics, roles, 
activities, and presenta- 
tions and provides posi- 
tive reinforcement for 
student 
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B. ENABLING OBJECTIVE 

1 . Student Behavior: Shows pride in total 
school activities 

2. Teacher Behavior: Recognizes and displays 
work done by students 



C. ENABLING OBJECTIVE 

1 . Student Behavior: Achieves at highest level 

possible 

2. Teacher Behavior: Encourages responsible 

effort and adjusts assign* 
ments to individual 
achievement levels 

a ENABLING OBJECTIVE 

1. Student Behavior: Responds in class 

2. Teacher Behavior: Provides students with the 

opportunity to react sue* 
cessfully and responsibly 
in front of others 

E. ENABLING OBJECTIVE 

1. Student Behavior: Recognizes personal 

strengths and 

uses them in school work 

2. Teacher Behavior: Points out personal 

strengths to student and 
suggests ways he might 
utilize them 

THE READING TEACHER 

February 1972 

Self -concepts 

How one views himself is most important. In a sense) 
the individual's self-concept acts as a perimeter, as a 
boundary which defines the limits of his actions. Actions 
and thoughts which woud lead to a new self -concept are 
limited by this perimeter i\nd hence, changing one's self 
concept is ^ most difficult process. An individual will 
steadfastly protect ^he image he has of himself even though 
it may interfere with achieving goals to which he and the 
society in which he lives aspire. 

Why is the self -concept so difficult to change? First, 
the time factor has to be considered. One's self -concept 
has been developed extremely well and over a long period 
of time. Furthermore, a negative self-image has prevented 
the individual from learning responses which would have 
helped him overcome inferior feelings. The ^^bility to take 
actions contradictory to that image is blocked by the 
image itself. A negative self-image is its own defender. 

What is a healthy, positive, self-concept, one that a 
teacher should help his pupils to develop? A person with 
a positive self*concept: 

- is able to accept himself as a person of worth 

- can realistically appraise his abilities and Hmitations 

- recognizes both his good and bad points 

- realizes he must be open to change both externally 
and internally 

- can accept his shortcomings without endlessly blam- 
ing himself 

- does not expect himself to be infallible 

- has a certain pride in his own thoughts and inclinations 



- feels he has a right to his individuality 

In short, his self-concept has a degree of stability 
(Rosenber, 1965) 

In one study pertaining to self-concept, a national 
sample of eleven to thirteen year old boys was taken 
(SRC,1960). As part of the study^the boys were given 
a self-rating device. They were asked how they perceived 
themselves and how they believed significant people in 
their lives - mothers, fathers, teachers, friends and club 
leaders - perceived them. 

Only 19 percent of the boys had highly positive self- 
concepts. Thirty-nine percent were rather ambivalent about 
themselves, while 41 percent lived with definitely negative 
feelings concerning their own worth. Only 27 percent 
felt that their ^eachers perceived them in a positive light. 
Forty-seven percent of the group perceived their teachers' 
behavior and feelings toward them as negative. And it is 
the pupils' interpretation that makes the difference - not 
the teacher's judgment of his treatment of the pupils. 

Removing Barriers 

There is a happy note. Self-concepts can be changed no 
matter how difficult it is to do so. It is important for 
teachers to be aware of how they can help their pupils 
build positive, realistic self-perceptions Just how can the 
teacher help move more pupils to achieve this important 
positive view of themselves? 

Perhaps first one should look carefully at the educa* 
tional system itself, which seems to have a built-in pro- 
gram of failure. According to the system, a certain per- 
centage of boys and girls are expected to fail. Uncon- 
sciously, through his own expectations, the teacher may be 
providing validity for this system. 

As Locky (1945) stated a quarter of a century ago, the 
mind is a unit, a system of ideas which mu^t be consis* 
tent with each other. Resistance to ideas develops when 
the idea is incompatible with tie organization of develop- 
ed roncepts. Boys and girlie can develop such a resistance 
to any type of material, to any particular subject. Lecky 
found exceptional progress in all school subjects once 
pupils saw that certain learning tasks were in consonance 
with feelings about their own abilities to learn. 

Furthermore, a teacher can inspire confidence. Unless 
the teacher is confident that his pupil will be successful, 
the child will probably not change his self-image of being 
a failure in reading or in any other school subject. 

The Teacher's Challenge 

It is very difficult ' j hide one's true feelings from 
children. Their p^* wuptions of adult expectations are 
derived from very subtle cues through an astute and com* 
plex process. A child can tell when an adult really has 
faith in him and when he is only paying lip service to a 
belief. 



40 



A study reported in June, 1970 (Rist, 1970), tells of a 
kindergarten teacher placing' children in groups which re- 
flected the social composition of the class. The different 
manner in which the teacher behaved toward the various 
groups become an important factor in determing each 
child's achievement. 

Without the availabiiity of any test scores or previous 
record of achievement, the children were placed at various 
tables on the basis of their supposed ability to learn. 
Children grouped at table one were designated as fast 
learners; those at table two were considered average; those 
at table thre^ slow learners. 

Of course, once the teacher had seated the children on 
the basis of predicted learning ability, she was motivated 
to make these predictions come true. The children were 
informed of her expectations in the way in which they 
were treated. For example, the blackboard was long and 
opposite all of the tables. Nevertheless, all writing was 
done on the section opposite table one. One little girl 
at table three stood up to seti as the teacher was demon- 
strating how to write an "o''; she was told to sit down. 
When she squir led around to see the writing she was 
commanded to sit straight in her chair. This reprimand 
resulted in the child's looking ;way from the board and the 
demonstration. The little girl gave up completely and laid 
her head on the table. 

By May of that ym, during one full hour of teaching, 
one ob:ecver noted th?t all of the interaction was between 
the teacher and pupils at table one except for two ex- 
changes. These two exchanges were directed at table three 
"Sit down!" 

If there is a ^yeater tragedy than being labeled a slow 
learner, it is being treated as a second class citizen. This 
teacher I am certain had no malice in her heart toward 
those designated as slow learners. Neighter was she a pocr 
teacheri the quality of her instruction was high. But her 
efforts were not directed toward all pupils alike. Un« 
doubtedly she would have been crushed had the devas- 
tating effect of such behavior on these children been ex- 
plained to her. But the effect on the pupils was just as 
serious as if her objective had been to destroy them. As 
the children passed on^to the other grades they tended to 
retain their original groupings. With time they perceived 
themselves as failures and their lack of performance in 
reading and in other areas reflected their selt*concepts. 

Certainly the task of replacing a child's negative self- 
concept with a more positive image is most difficult, but 
obstacles to learning can be removed. It is the teacher 
and the teacher's belief in the pupil's success that can 
inspire such a transformation. 
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GUIDE FOR IMPROVEMENT OF SELF-CONCEPT 

Following are recommendations that, hopefully, will help 
enhance each child's self-concept and develop in each a 
feeling of well-being. When implementing these suggest- 
ions, the tutor should keep in mind that his or her under- 
lying attitude and the room atmosphere are of utmost 
significance. Too, none of these activities must be allowed 
to become automatic or rote; the child should have 
some understanding of what he is experiencing. 

1. Realistic, life-like materials should be used in help- 
ing children understand themselves and the concepts 
you are trying to develop. 

A. Cameras 

Use a Polaroid camera to take posed and candid 
pictures of the children. It is theii possible 
to show the posed ones immediately. The 
candids can be discussed as a f olow-up to the 
activity pictured. The children may need help 
in recognizing themselves and their peers. 
"How do you know that is you?" and "How 
do you know that Is Jimmy?" are typical 
questions which can be used. 

B. Telephones 

- to help children with communlca- 
tion skill, telephone etiquette, verbalization, 
scientificlnquiry. 

C. Interest Area 

- As you interact with the child, 
you will discover an area of interest, things he 
feally likes or wants to do. Capitalize on this. 
Arrange for experiences to promote further learn- 
ing in this area. 

D. Tape Recorder 

1. Let child speak into the tape recorder. In the 
beginning the play-back should be immediate 
so he can hear his voice. Afterwards discuss 
what was said, what would be another way 
of saying it. Record what was <ipoken. 

2. Have individual children learn the proper use 
of the tape recorder when they show a parti* 

4: jL ^^1^'' interest. 

E. Pictures of Ethnic Groups 

1. Provide pictures of people in various oc« 
cupatlonal roles. 
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2. Provide pictures of various everyday activi* 
ties familiar to the children. The discussion 
prompted by these will provide opportunities 
for you to learn to know you. 

F. Games 

Games such as chess, dominoes, monopoly, 
etc., can provide opportunities for all kinds of 
interaction and learning experiences that 
can lead into skills schievement. 

Human Resources and Attitudes 

The tutor should serve as a central, stablee adult 
figure at all times. A basic understanding of child* 
ren is essential for all adults who work with 
them. 

A. Male Image 

1. Having the same male figure to visit with on a 
regular basis establishes with the children that 
they have a stable male who is Interested in 
them and concerned about them. 

B. Insights 

1. Remember that the child is not fragmented 
Into parts any more than his environment is 
fragmented into elements. He is an integrated 
whole, functioning in a coordinated, organized 
universe; he may be small but he is extremely 
important. 

2. Recognize that how a person feels probably is 
more Important than what he knows. Helt^ the 
child to express and understand his feelings. 

3. Be aware that the attitudes of significant 
adults impart an indelible impression on the 
child's concept of himself. Through his rela- 
tionships with others, the child grows in 
awareness, sensitivity, and perception. 

4. Realize that the child's development of a 
feeling of adequacy depends on his receiving 
support, reinforcement, and guidance during 
the period of early childhood. 

5. Keep In mind that, in order to become self* 
reliant, a child must have numerous oppor- 
tunities to make choices. 

6. Know that developmental timing is extremely 
Important. The child's sense of independence 
may be destroyed by pressuring him to do that 
for which he is not ready. 

C. Precepts 

1. Accept the child as he is. 

2. Do not shame or embarn^^ him 

? Do not cause him to doubt that he is a person 
of worth; respect him and hi.i needs. 



4. If behavior is an ic^ue, let him know that you 
disapprove of his actions, not him. 

5.. Be firm but tolerant with him. 

6. Meet any negatlvistic behavior with kind firm- 
ness, consistency, knowledge of what con- 
stitutes a problem to the child. 

7. Prepare a stimulating environment based on 
sensitivity to the child's world. 

8. Provide ample opportunity for each child to 
experience some success each session. 

9. Listen to the chilii. Let him talk. Listen with 
your ears and your eyes. 

10. Answer each child's questions honestly, at* 
tentively, and immediately whenever possible, 

11. Make the child feel that he is wanted, that he 
belongs, and that he is free to make mistakes 
without penalty. 

ACHIEVEMENT IN THE AFFECTIVE DOMAIN 

SELF-CONCEPT DEVELOPMENT 

T he development of positive self-regard is one of the 
primary objectives of the Learning Center Project. Ppr- 
scnalizing education implies a humanistic approach wherin 
a student feels good about himself, about his peers, about 
his family, and about his school. A great deal of recent 
research indicates that there is a definite correlation be- 
tween self-esteem and academic achievement. A definition 
of self-esteem will be found in the terminal objectives 
identified below. 

SOCIAL LEARNING MODEL 

The Learning Centers have adopted a Social Learning 
Model as the theoretical base for promoting achievement In 
the affective domain. Briefly, the model is outlined as 
follows: 

1. Identify Terminal Objectives (desired outcomes). 

2. Identify Enabling Objectives (the sequence of be« 
haviors which will lead to the accomplishment of the 
Terminal Objective). 

3. Formulate student tasks which will promote devel* 
opment of the enabling behaviors (these are des- 
cribed as (a) Student Behaviors vnd (b) Teacher 
Behaviors). 

4. Positively reinforce behaviors oriented toward the 
Enabling Objectives. 
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FORMULATION OF OBJECTIVES 

Formulating behavioral objectives for the affeci oe 
domain has proved to be one of the most difficult tasks 
faced by the consultative team, since there are no known 
models to follow. Specialists In the Research Department 
wrote a rough draft of objectives based on item analyses 
of various Instruments which purported to measure self* 
esteem and classroom adjustment. These objectives were 
refined by Learning Center teachers and consultants during 
a workshop dealing with the affective development of 
students in the Learning Centers. 

The objectives were further refined by the consulta* 
tlve team at a later date. The teacher and/or counselor 
will need to restate the Enabling Objectives in more pre* 
else behavioral terms since In their present form they 
offer, at best, a board description of the component areas 
of self-esteem and satisfactory interpersonal relation- 
ships. 

No attempt has yet been made to arrange the objec- 
tives Into a hierarchical continuum. Perhaps this will be 
attempted at a later time. It seems that, for the present, 
an objective should be written for an individual student 
at any level of development where a need Is seen. The 
Coopersmlth Self-esteem Inventory or other suitable in- 
strument may be administered to determine specific 
areas where Improvement Is most needed. During the 
ensuing year, an attempt will be made to collect specific 
objectives for dissemination to all Learning Centers at a 
future time. 

Recognition Is given to the following sources, which 
proved useful in writing and refining the objectives: 

Stanley Coopersmlth, The Antecedents of Self-Esteem. 
San Francisco: W. H. Freeman Co., 1967. 

Donald DInkmeyer, Child Development: The Emerging 
Self. EnglewoOd Cliffs: Prentice-Hall, Inc., 1965. 

Developing Understanding of Self 

an d Others (Manual for DUSO Kit D-1), Circle Pines, 
Minn*: Merlcan Guidance Service, Inc., 1970. 

Don E. Harrvinf^^k, Encounters With The Self. N ew York: 
Holt, Rlnehart, and Winston, 1971. 

David R. Krathwohi, Benjamin S. Bloom, and Bertram 
B. Mascla. Editors, Taxonomy of Educational Ob- 
jectives: The Classification of Edcuational Goals, Han>* 
book II, The Affective Domain. New York: David 
McKay Co., 1964. 

Virginia M. Macagnoni, Social Dimensions of the Self as a n 
Open System: A Curriculum Design, Research Bulletin, 
Galnsvllle, Florida: Florida Educational Research and 
Development Council, 1970. 
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William R. Purkey, Self Concept and School Achievement. 
Englewood Cliffs: Printtce-Hall, Inc., 1970. 

MISCELLANEOUS NOTES ON "SELF IMAGE" or 
"SELF-CONCEPT" 

From: Psycho-cybernetics, by Mazwell Malts, M.D. 

"The 'self-Image' Is the key to human personality and 
human behavior." 

"Expand the self-image and you expand the 'area of the 
possible'." 

"The self-image is changed, for better or worse, not by 
intellect alone, nor by intellectual knowledge alone, but 
by 'experiencing'." 

"This self-image Is our own conception of the 'sort of 
person I am\ It has been built up from our own beliefs 
about ourselves. But most of these beliefs about ourselves 
have been unconsciously formed from our past experi- 
ences, our sur'.dsses and failures, our humiliations, our 
trlumps, and the way other people have reacted to us, 
especially In early childhood. From all these we mentally 
construct a 'self (or a picture of a self)." 

"Once an Idea or belief about ourselves goes Into this 
picture It becomes 'true', as far as we personally are con- 
cerned. We do not question Its validity, but proceed to 
act upon It lust as If It were true. " 

"All your actions, feelings, behavior - even your abilities 
- are always consistent with this self-image. In short, you 
will 'act like' the sort of person you conceive yourself to 
be. Not only this, but you literally cannot act otherwise. 
In spite of all your conscious efforts or will power." 

"The man who conceives himself to be a 'failure-type 
person' will find some way to fall, in spite of all his good 
intentions, or his will power, even If opportunity Is literally 
dumped In his lap. One who conceives himself to be a 
victim of Injustice, one 'who was meant to suffer', will 
invariably find circumstances to verify his opinions." 

"The self-image can be changed." 

SOME WAYS TO CHANGE SELF-IMAGE 

ROLE PLAYING - By solving problems In your mind, 
you know what to say and do when 
the situation comes upon real life. 

IMAGINATION - Rehearsal of situations In the mind. 

Provides confidence. (Even 1 concert 
pianist can practice "In his head." 

FINDING YOUR BEST SELF - Form a picture In your 
Imagination of the self you want to 
if o be and "see your self" In this new role. 

^ . This Is a necessary condition to per- 

sonality transformation." (Somehow, 



before a perion c«n change, he must 
see himsolf In a new role.) 

DEHYPNOTIZATION - Programming of success 

1. You are not an Inferior person. 
(Not measuring up In some area 
does not make you Inferior.) 

2. You are a worthY person. 

REINFORCEMENT 



Robert E. Valett, Effective Teaching: A Guide to DIaonos- 
nostic-Prescrlptive Task Analysis (Belmont. Calif.: Fearon 
Publishers). 1970. p. 33. 

I. SOCIAL REINFORCERS - Most effective basic 
motivators In human behavior 

A. Interpersonal recognitions 

B. Acceptance 

C. Encouragement 

II. TANGIBLE REINFORCERS - Effective, but must 
be carefully arranged for different children and 
varying age levels. 

A. Foods 

B. Toys 

C. Trips 

D. Special Privillges 

III. SYMBOLIC TOKENS - Can be exchanged for 
activities or things of value 

A. Money 

B. Grades or Marks 

C. Certificates 

IV. INTRINSIC SELF-SATISFACTION AND AWARE- 
NESS 

"... desirable relnforcers for all children in the 
classroom although this type of reinforcement Is not 
sufficient for most students with learning problems." 

V. OTHER FACETS 

Students can be reinforced at different times and 
places. 

When a new learning task Is presented - reinforce 
Guccessful performance or Its approximation. 

Later on - reinforce on an Intermittent or variable 
bosii. 



Students can also obtain reinforcement on a pre* 
determined schedule (e.g. end of a time period, 
upon lesson completion, upon accumulation of a 
number of tokens. 

WHAT TEACHER PRACTICES ARE CONSTRUCTIVE? 

The schoolwork of teachers and pupils can bo greatly 
facilitated by the right kind of classroom atmosphere. 
The setting the good teacher tries to establish discourages 
hostility In the classroom. One author has Identified 
some of the practices that tend to Increase or decraai« 
hostility. A part of the list appears below. 



Practices That Increase Hostility 

1. negative statements bv the teMhar 
Here are a few examples of ridicule, sarcasm, criticism, 
negative, and tenslon-<produclng statements made by a 
teacher. Such statements to children Invariably lead to 
hostility, emotional disturbance, selfishness, fear, and 
criticism of others: 

"I wish you would start acting like fourth graders In* 
stead of kindergarteners." 

"Someone Is whispering again, and I guen you alt know 
who It Is." 

"Most fifth grade classes could understand this, but I 
am not sure about you." 

2. excessively competitive situations 

Fair competition In classrooms Is highly desirable. It 
can stimulate good work, motivate children to do their 
best and help children learn thoee graces associated 
with winning and losing. It becomes undesirable when 
It Is of the "dog-eat-dog" variety where each child Is 
pitted against every other child whether the com* 
petitlve situation Is fair or unfair. 

3. dis regard for individual dlffera niyi 

Classrooms where some children are made to feel "this 
place is not for me" contribute much toward breeding 
hostility In children. Such rooms are characterized by 
one level of acceptable performance applied to all, 
uniform assignments, one system of reward, great em- 
phasis upon verbal, Intellectual performance. 

Practices That Decrease Hostility 

1. positive statem ents by the teacher 

Fritfndly. constructive statements by the teacher tend to 
reduce tensions and hostility In the classroom. Here 
are a few examples: 

"We will all want to listen rirefully In order not to 
miss anything Sue Is going to tell us." 
"All of us did our work so well yesterday during our 
work period. Do you suppose we can do as well today?" 
"It Is really fun for all of us when you bring such In- 
teresting things for sharing." 
A A "It's nice to have Bill and Sue back with us again. 

The boys and girls were hoping you would come back 
today." 



ERIC 



3d 



2, successful cooperative enterprises 

The successful achievement of cooperative activities, 
involving all members of the class, tends to reduce 
hostility within the group because it demands the 
combined efforts of everyone in the successful attain- 
ment of a common goal Children depend upon one 
another in such situations and, therefore, feel a need 
for or 3 another* 

3. recognition of and adaptations made in accordance 

with individual differences 

In such classrooms, each child is challenged at a level 
commensurate with his ability. Each child feels that he 
''counts for something" in the classroom and that he 
belongs to it. 

DIRECTIONS FOR TEACHER ACTION BASE D ON 
"CHILDREN LEARN WHAT THEY LIVE" 

1. Do you criticize students? 

List adJectives\you used this week about students. 

List comments you made on student papers. 

Tape a class discussion and listen to your tone of 
voice. 

2. Do you ever react hostilely to students? 

Ask students to write you a note if they hear you 
are being hostile to them. 

3. Do you ridicule students? 

List any pet derogatory names you have for problem 
students. 

Use suggestion in No. 1. 

4. Do you ever shame students? 

List an occasion on which you used a child as an 
example to the whole class. 

6. List how you demonstrated tolerance this week. 

6. List one way in which you encouraged or will en- 
courage a student. 

7. List a situation in which you did or will praise a 
student. 

8. List a situation in which you did or will display 
fairness. 

9. List a way in which you did or wil! provide security. 

10. List ways in which you did or will show approval to 
students. 



POETRY ON SELF-ESTEEM 

"CHILDREN LEARN WHAT THEY LIVE" 

"If a child lives with criticism. 
He learns to condemn. 

It ^hild lives with liostility, 
He learns to fight. 

If a child lives with ridicule. 
He learns to be shy. 

If a child lives with shame. 
He learns to feel guilty. 

If a child lives with tolerance, 
He learns patience. 

If a child lives with encouragement. 
He learns confidence. 

If a child lives with praise. 
He learns to appreciate. 

If a child lives with fairness. 
He learns justice. 

If a child lives with security, 
He learns to have faith. 

If a child lives with approval. 
He learns to like himself. 

If a child lives with acceptance and friendship, 
He learns to find love In the world." 

"SELF.ESTEEM" 

When the other fellow taices a long time, he's slow. But 
when I take a lonq time I am thorough. 

When the other fe'low doesn't do it, he's lazy. But 
when I don't do it, I'm too busy. 

When the other fellow does something without being 
told, he's overstepping his bounds. But when I do it, that 
is inltiativel 

When the other fellow takes a stand, he's bullheaded. 
But when I do it, I'm being firm. 

When the other fellow overlooks a rule of etlquot, he's 
rude. But when I skip a few rules, I'm original. 

When the other fellow pleases the boss, he's polishing 
brass. But when I please the boss, that's cooperation. 



1 1 . List ways In which you showed or will show ac- When the other fellow gets ahead, he's getting the breaks, 

ceptance of students. >l ir But when I manage to get ahead, it's hard work. 



APPENDIX A 
OBJECTIVE AND ACTIVITIES 
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APPENDIX C 
TEACHER INFORMATION 



GENERAL INFORMATION GUIDE FOR TEACHERS 
"PROJECT A.R.T.A/' 



"A Road To Accountability" 

General and specific information relative to the operation 
of Project A.R.T.A. for the school year 1973-1974. 

General Information: 

1. Each teacher who becomes a participant in Project 
A.R.T.A. has done so by volunteering. 

2. Throughout the school year each teacher can expect 
to fill out some questionnaires relative to the project. 

3. By State request a controlled group needs to be im* 
plemented for comparison to provide data on cost ef- 
fectiveness, exportability as well as innovativeness. 
We would like to have at least 2 second grade, 2 fifth 
grade, 1 eight grade and 1 tenth grade teacher to 
volunteer for this controlled group. The controlled 
group would administer their tests, attend one meeting, 
August 28, 1973, and acknowledge pre and post test* 
ing dates as set forth by A.RT.A. 

4. Various organizations and committees may visit your 
classroom for observation - seeking greater insight of 
the program. 

5. To help the dissemination of the program, we are ask- 
ing each teacher to share her knowledge of the program 
with their colleagues and any interested Individual or 
group. 

6. To enhance the program, we welcome all construct) j 
criticism as the program progresses. Keep in mind that 
you are a part of the program and the program can 

be only as affective as you the Individual want to make 
it. 

7. Payroll deductions: No payroll deductions will be with* 
held due to the nature of the program and It will 
become your responsibility to make your individual 
declarations for Internal Revenue and State Tax. 

8. No additional Hardware or Software will bd provided 
by the project for the teachers. The material that each 
school district supplies for their system will be of 
significant nature to supplement your teaching. 



Specific Information; 

1. Me eting Dates: Time; 

August 28, 1973 7:30 pm 

(All teachers) 

September 6, 1973 7:30 pm 

November 29, 1973 7:30 pm 

January 24, 1974 7:00 pm 

April 18, 1974 7:00 pm 



Place: 

ARTA Central 

Office - El Reno 
ARTA Central Office 
ARTA Central Office 
ARTA Central Office 
ARTA Central Office 
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2. Testing Dates : 

Pre-Test: September 10-14, 1973. One (1) week al- 
lowance to administer the tests with make 
up tests to follow as soon as possible. 
Each teacher will administer her own test. 
Tests will be 

scored by ARTA personnel. 

Post-test: April 22-26, 1974. All students shall be 

administered the test regardless if they took 
the Pre-test or not. The Pre and Post Tests 
will be picked up on the following Monday 
of each testing dates, i.e., September 17, 
1973 and April 29,1974. 

3. Anecdotal Record : 

Each teacher shall be asked to keep an ar^ecdotal record 
of their students and this record will picked up on 
May 28, 1974. Modified behavioral changes should con* 
stitute most of the Anecdotal record with any other 
commentary the teacher will want to make concerning 
her students. 

4. Teacher-Parent Conference ; 

We are asking each teacher to make the necessary con* 
ferences with parents for greater identification with her 
students. Conferences may constitute a home visitation, 
conference at school, telephone, Open House, Social 
Activity, etc. Keep a record of Vour visitations, 

5. Self Concept: 

Self Concept shall carry a weighted monetary value of 
20%. 

6. Attrition : 

We will keep attrition in the program but it will not 
have any monetary value. 

7. Another chargeable variable of the program and will 
have monetary value of approximate 20%. Last year's 
attendance versus this year's attendance. School regis* 
tors will be the official record. This record is due May 
28, 1974. 



8. Achievement: 

Another chargeable variable with 60% monetary value. 
Pre test scores gains from Post test scores to reach 
expected gains. 

9. Formula: 

(1) The formulas for incentive payments are as follows: 

Elementary: $ = [2400 (a) + 13.3 (b) + 200 (c)] x d 
Secondary: $ ^ [2400 (z) + 32.0 (b) + 200 (c)] x d 

(2) Variable (a) is the net achievement term from the 
table. It is calculated by subtracting the expected 
gain from the attained achievement gain. This term 
is then multiplied by $2400, the dollar-weighted 
constant for achievement gains. 

(3) Variable (b) is the net self-esteem term from the table 
obtained by subtracting the expected gain of 3.25 
for elementary or 3.50 for secondary from the at- 
tained self-esteem growth. This net self-esteem Is 
then multiplied by the dollar constant of 13.3 for 
elementary or 32 for secondary. These constants 

are different due to having different test instruments 
and the fact that self-esteem declines with increasing 
age. 

(4) Variable (c) is the net average daily attendance 
(A.D.A.), which is obtained by subtracting the 
mean ADA for 1972-73 from the mean ADA for 
1973-74. $200 is the constant for ADA. 

(5) The final term in the equation, (d), gives the frac- 
tional part of $2,000 for which the class is worth. 
For example, one section of mathematics (or any 
other curriculum) could earn $400 for the teacher 
if maximum gains occur. Since $400 is 1/5 of 
$2000, the term (d) for any one section is 1/5 or 
0.2. The equation is computed for each section that 
8 teacher entered into the project, and then the 
dollar gains, if any, of each section are added for 
teacher's total payment. Five class sections are 
valued at $2,000 because 5 x 0.2 [$2000] $2,000. 
Also any self-contained classroom, e.g., second grade 
could have attained the maximum payment if the 
reading and arithmetic gains (worth 0.5 of $2,000 
each), along with attrition and attendance, were 
high enough. 

(6) These three constants might have to be changed 
from year-to-year for two reasons: (a) to equalize 
numerically between the typical gains made in 
achievement, self-esteem, and average daily attend- 
ance; (b) to make each of the three aforementioned 
factors have dollar weights of 60%, 20% and 20%, 
respectively. Dollar weights must be pre-determined 
for each factor in order to set the rT.:nimum net 
gain allowed for maximum incentive payments. 
Each factor is set so that approximately 1 5% of the 
teachers with highest net gains will receive maximum 
payment on any or all factors. 



(7)The row total in dollars may exceed the maximum 
allowed row payment if a teacher had a net gain 
greater than the minimum net gair^ for maximum 
payment. Maximum row payments depend upon 
the pay ^^ent factor (d) for the section or class. For 
examp.d, the maximum row payment is $1,000 
in a self-contained class for reading achievement 
with a payment factor of 0.5. A math teacher with 
five sections; each section would have a payment 
factor of 0.2 and be worth $400 as a row maximum. 

10. Enrollment: 

Your enrollment on September 10, 1973 will be the 
commencing date and all students on roll as of this 
date shall become chargeable to the program. Any 
student after this date is non-chargeable. 

11. New Students: 

All students who are new to the School District for 
the school year 1973-74 shall be identified as new and 
each teacher shall acquire the students' previous school 
of attendance as she submits here certified, alphabetized 
list of students to Project A.R.T.A. 

Please ask the parent or student of previous ^ittendance 
as we will need the following information to acquire 
the statistical data on each student: Name of School, 
Name of Town. Name of State: Zip Code. Also check 
to see if the new student may have attended more 
than one school. Check to see if the new student may 
have used any other name. 

12. On Site Evaluation, State Department of Education: 

The Stato Department of Education will conduct two 
(2) On Site Evaluations during the school year. The 
dates are to be selected by the State Department, 
usually in October and April. ^ 

13. Pre-Service and In-Service Meetings; 

Each meeting will be two hours and each teacher will 
be paid $3.00 per meeting for their attendance. 

14. Final Reports ; 

All reports on Attendance, Attrition and Anecdotal 
records shall be due on May 28, 1974 

15. Final Payment: 

Using school year 1973 as an example, we expect to 
pay around July 15, 1974. 

18. School District Participation ; 

Each participating school district has given their per- 
mission-consent to participate in the program and are 
knowledgeable of the program. 

Project A.R.T.A. does not intend or want to ercroach 
upon any school district nor become a disruptive agent 
therefbre it is our belief the cooperative venture can 
be well received as an Innovative and Exemplary 
;q program. 
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17. A.RTA Central Office: 

310 West Wade, P.O. Box 806, El Reno, Oklahoma 

73036 

Director: Raymond E Roblyer, Secretary: Mrs. Betty 
Barton 

Telephone: 262-6222 

This office is available for speaking engagements per- 
taining to Project A.R.T.A. 



PROJECT: A.R.T.A, TITLE III, E.S.H.A. 
'TEACHER ACCEPTANCE CONTRACT" 
School 



Grade 



Subject 



I. 



hereby accept and/or volunteer to participate in "Project 
A.R.T.A/' a Title III, E.S.E.A. Project, for the school 
year 1972-73. 



PROJECT A.RT.A. 
Teacher Information 
Name 



Address 



Telephone 
School 



Grade 



Experience: 



(Total Years Taught) 



Latest School Attjnded: 



Will you have an accelerated group? Yes. 
If yes, How Many Students? 



No, 



How Many Sections? 



Would you like to participate in the A.R.T.A. Program? 
Yes No 



Signature 
Maximum Possible Earnings: $ 
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